Children contacting Childline about AI-generated online harms, NSPCC says

25 January 2024, 00:04

A child using a laptop computer
AI in schools. Picture: PA

The children’s charity has launched a new partnership with a US-based safety group to lobby for child safety rules in the development of AI tools.

Young people are contacting Childline about AI-generated child sexual abuse material, the NSPCC has said as it announced a new partnership aimed at championing child safety during the development of new AI technology.

The children’s charity said young people had also contacted Childline about harm linked to generative AI, including the spread of misinformation and bullying.

It comes as the charity unveiled a new advocacy partnership with US children’s safety group Common Sense Media which will see the groups look to pressure tech firms and politicians over ensuring child safety and wellbeing are central to decision-making around artificial intelligence.

Debate around how to safely develop AI tools has intensified over the last 12 months as the technology has become increasingly mainstream, thanks to the rise of generative AI chatbots such as ChatGPT.

The risk children face from unregulated and unsafe AI is already far too high, and their safety and experiences must be at the centre of conversations about its development and regulations

Sir Peter Wanless, NSPCC

As part of the new partnership, the NSPCC and Common Sense Media will also roll out education programmes designed to increase digital literacy skills in schools and carry out more joint research on the impact of generative AI on children.

NSPCC chief executive Sir Peter Wanless said: “As one of the leading voices helping to achieve the Online Safety Act in the UK, we have long acknowledged the need for global collaboration by governments, civil society and tech firms to drive children’s safety online.

“This cannot be clearer than in AI where a rush to glean the significant benefits of technology has led to worldwide concerns about the danger it can also pose.

“The risk children face from unregulated and unsafe AI is already far too high, and their safety and experiences must be at the centre of conversations about its development and regulations.

“This partnership will seek to do that while also empowering young people with digital literacy skills to help them thrive.”

James P Steyer, founder and chief executive of Common Sense Media, said: “To safely and responsibly harness the potential of AI for children, global organisations must work together to ensure that the government and private sector have children’s best interests at heart for all technology design, development, and deployment.

“The NSPCC, and the UK more broadly, is seeing great progress by activating its educators, parents, and policymakers, and we look forward to amplifying their efforts in the US and globally.”

By Press Association

More Technology News

See more More Technology News

A child’s hand pressing a key of a laptop keyboard

Charity ‘appalled’ at reports online safety laws could be cut for US trade deal

School children during a Year 5 class at a primary school

Education Secretary: More men needed in classrooms to be positive role models

Games controller

Cult classic Shenmue named most influential game of all time in Bafta poll

Alliance MP Sorcha Eastwood (PA)

Parents crying out for online regulation, MP Eastwood says

TikTok is set to be banned in the United States later this week unless a buyer emerges.

Amazon makes last-minute bid to buy TikTok as deadline looms

Nintendo Switch 2

Everything you need to know about the Nintendo Switch 2

The Nintendo Switch 2 will release on June 5, 2025

Nintendo Switch 2: Exciting reveal, but why is it more expensive here?

A Nintendo Switch 2

Nintendo confirms Switch 2 will launch on June 5

Tesla dealership damage

Tesla sales tumble to weakest since 2022 amid Musk backlash

The Nintendo Switch 2

Nintendo reveals release date for long-awaited Switch 2 console

Roblox has introduced a slew of new safety features.

Gaming platform Roblox adds slew of safety fixtures for parents to monitor their children’s accounts

Meta's decision to change its content policies was heavily criticised by online safety experts (PA)

Majority oppose Meta’s rollback of safety rules, charity says

A child's hands pressing laptop keys

Regulation and technology can help combat spread of online misogyny, expert says

Raspberry Pi 4 micro computer

Raspberry Pi profits tumble after supply shortages

An RNLI lifeboat brings a group of people thought to be migrants into Dover

UK to work with allies and social media to tackle people smuggling adverts

A child using an Apple iPhone smartphone

School curriculum resources to teach children about risks of in-game purchases