Children contacting Childline about AI-generated online harms, NSPCC says

25 January 2024, 00:04

A child using a laptop computer
AI in schools. Picture: PA

The children’s charity has launched a new partnership with a US-based safety group to lobby for child safety rules in the development of AI tools.

Young people are contacting Childline about AI-generated child sexual abuse material, the NSPCC has said as it announced a new partnership aimed at championing child safety during the development of new AI technology.

The children’s charity said young people had also contacted Childline about harm linked to generative AI, including the spread of misinformation and bullying.

It comes as the charity unveiled a new advocacy partnership with US children’s safety group Common Sense Media which will see the groups look to pressure tech firms and politicians over ensuring child safety and wellbeing are central to decision-making around artificial intelligence.

Debate around how to safely develop AI tools has intensified over the last 12 months as the technology has become increasingly mainstream, thanks to the rise of generative AI chatbots such as ChatGPT.

As part of the new partnership, the NSPCC and Common Sense Media will also roll out education programmes designed to increase digital literacy skills in schools and carry out more joint research on the impact of generative AI on children.

NSPCC chief executive Sir Peter Wanless said: “As one of the leading voices helping to achieve the Online Safety Act in the UK, we have long acknowledged the need for global collaboration by governments, civil society and tech firms to drive children’s safety online.

“This cannot be clearer than in AI where a rush to glean the significant benefits of technology has led to worldwide concerns about the danger it can also pose.

“The risk children face from unregulated and unsafe AI is already far too high, and their safety and experiences must be at the centre of conversations about its development and regulations.

“This partnership will seek to do that while also empowering young people with digital literacy skills to help them thrive.”

James P Steyer, founder and chief executive of Common Sense Media, said: “To safely and responsibly harness the potential of AI for children, global organisations must work together to ensure that the government and private sector have children’s best interests at heart for all technology design, development, and deployment.

“The NSPCC, and the UK more broadly, is seeing great progress by activating its educators, parents, and policymakers, and we look forward to amplifying their efforts in the US and globally.”

By Press Association

More Technology News

See more More Technology News

Pat McFadden

Russia prepared to launch cyber attacks on UK, minister to warn

A person holds an iphone showing the app for Google chrome search engine

Apple and Google ‘should face investigation over mobile browser duopoly’

A Google icon on a smartphone

Firms can use AI to help offset Budget tax hikes, says Google UK boss

Icons of social media apps, including Facebook, Instagram, YouTube and WhatsApp, are displayed on a mobile phone screen

Growing social media app vows to shake up ‘toxic’ status quo

Will Guyatt questions who is responsible for the safety of children online

Are Zuckerberg and Musk responsible for looking after my kids online?

Social media apps on a phone

U16s social media ban punishes children for tech firm failures, charities say

Google shown on a smartphone

US Government proposes forcing Google to sell Chrome to break-up tech empire

The logo for Google's Gemini AI assistant

Google’s Gemini AI gets dedicated iPhone app in the UK for the first time

Facebook stock

EU fines Meta £660m for competition rule breaches over Facebook Marketplace

A phone taking a photo of a phone mast

Government pledges more digital inclusion as rural Wales gets phone mast boost

Social media apps displayed on a mobile phone screen

What is Bluesky and why are people leaving X to sign up?

Someone types at a keyboard

Cyber security chief warns Black Friday shoppers to be alert to scams

MPs

Ministers pressed on excluding Chinese firms from UK’s genomics sector

Child with mobile phone stock

Specially designed smartphone for children launches in the UK

Roblox on a laptop

Children’s gaming platform Roblox makes ‘major update’ to parental controls

An offshore wind farm

Government launches competition to find AI solutions to boost UK clean energy