Children contacting Childline about AI-generated online harms, NSPCC says

25 January 2024, 00:04

A child using a laptop computer
AI in schools. Picture: PA

The children’s charity has launched a new partnership with a US-based safety group to lobby for child safety rules in the development of AI tools.

Young people are contacting Childline about AI-generated child sexual abuse material, the NSPCC has said as it announced a new partnership aimed at championing child safety during the development of new AI technology.

The children’s charity said young people had also contacted Childline about harm linked to generative AI, including the spread of misinformation and bullying.

It comes as the charity unveiled a new advocacy partnership with US children’s safety group Common Sense Media which will see the groups look to pressure tech firms and politicians over ensuring child safety and wellbeing are central to decision-making around artificial intelligence.

Debate around how to safely develop AI tools has intensified over the last 12 months as the technology has become increasingly mainstream, thanks to the rise of generative AI chatbots such as ChatGPT.

As part of the new partnership, the NSPCC and Common Sense Media will also roll out education programmes designed to increase digital literacy skills in schools and carry out more joint research on the impact of generative AI on children.

NSPCC chief executive Sir Peter Wanless said: “As one of the leading voices helping to achieve the Online Safety Act in the UK, we have long acknowledged the need for global collaboration by governments, civil society and tech firms to drive children’s safety online.

“This cannot be clearer than in AI where a rush to glean the significant benefits of technology has led to worldwide concerns about the danger it can also pose.

“The risk children face from unregulated and unsafe AI is already far too high, and their safety and experiences must be at the centre of conversations about its development and regulations.

“This partnership will seek to do that while also empowering young people with digital literacy skills to help them thrive.”

James P Steyer, founder and chief executive of Common Sense Media, said: “To safely and responsibly harness the potential of AI for children, global organisations must work together to ensure that the government and private sector have children’s best interests at heart for all technology design, development, and deployment.

“The NSPCC, and the UK more broadly, is seeing great progress by activating its educators, parents, and policymakers, and we look forward to amplifying their efforts in the US and globally.”

By Press Association

More Technology News

See more More Technology News

LG AeroCatTower (Martyn Landi/PA)

The weird and wonderful gadgets of CES 2025

Sinclair C5 enthusiasts enjoy the gathering at Alexandra Palace in London

Sinclair C5 fans gather to celebrate ‘iconic’ vehicle’s 40th anniversary

A still from Kemp's AI generated video

Spandau Ballet’s Gary Kemp releases AI generated music video for new single

DragonFire laser weapon system

Britain must learn from Ukraine and use AI for warfare, MPs say

The Pinwheel Watch, a smartwatch designed for children, unveiled at the CES technology show in Las Vegas.

CES 2025: Pinwheel launches child-friendly smartwatch with built in AI chatbot

The firm said the morning data jumps had emerged as part of its broadband network analysis (PA)

Millions head online at 6am, 7am and 8am as alarms go off, data shows

A mobile phone screen

Meta ends fact-checking on Facebook and Instagram in favour of community notes

Mark Zuckerberg

Meta criticised over ‘chilling’ content moderation changes

Apps displayed on smartphone

Swinney voices concern at Meta changes and will ‘keep considering’ use of X

sam altman

Sister of OpenAI CEO Sam Altman files lawsuit against brother alleging sexual abuse as child

OpenAI chief executive Sam Altman with then-prime minister Rishi Sunak at the AI Safety Summit in Milton Keynes in November 2023

OpenAI boss Sam Altman denies sister’s allegations of sexual abuse

A super-resolution prostate image

New prostate cancer imaging shows ‘extremely encouraging’ results in trials

Gadget Show

AI will help workers with their jobs, not replace them, tech executives say

Zuckerberg said he will "work with President Trump to push back on governments around the world that are going after American companies and pushing to censor more”.

Meta’s ‘chilling’ decision to ditch fact-checking and loosen moderation could have ‘dire consequences’ says charity

Twitter logo

X boss Linda Yaccarino praises Meta’s decision to scrap fact checkers

People walk by the Las Vegas Convention Centre

Smart home tech, AI and cars among central themes as CES 2025 prepares to open