Charity issues AI warning over online child sexual abuse

15 February 2024, 00:04

Online abuse
Online abuse. Picture: PA

New research from the Lucy Faithfull Foundation shows many adults worry about AI but were not aware it was already being used in online abuse.

Most UK adults have fears around the advances in artificial intelligence (AI), in particular in relation to its potential to harm children, but many are unaware about how it is already being used in sexual abuse, according to new research.

The study, from child protection charity the Lucy Faithfull Foundation, found that 66% of adults said they had concerns about the impact of the technology on children.

This was despite the research uncovering that the majority (70%) were not even aware that AI was already being used to generate sexual abuse images of children, and 40% did not know that such content was illegal.

The Lucy Faithfull Foundation said it was publishing its findings in an effort to boost awareness around the use of AI to exploit children.

The foundation, which runs the anonymous and confidential helpline Stop It Now, said it wanted to remind people of the law and what constitutes online child sexual abuse in the UK.

Donald Findlater, director of the helpline, said: “With AI and its capabilities rapidly evolving, it’s vital that people understand the dangers and how this technology is being exploited by online child sex offenders every day.

“Our research shows there are serious knowledge gaps amongst the public regarding AI – specifically its ability to cause harm to children.

“Unfortunately, the reality is that people are using this new, and unregulated, technology to create illegal sexual images of children, as well as so-called ‘nudified images’ of real children, including children who have been abused.

“People must know that AI is not an emerging threat – it’s here, now. Stop It Now helpline advisers deal with hundreds of people every week seeking help to stop viewing of sexual images of under-18s.

“These callers include people viewing AI-generated child sexual abuse material. We want the public to be absolutely clear that viewing sexual images of under-18s, whether AI-generated or not, is illegal and causes very serious harm to real children across the world.

“To anyone that needs support to change their online behaviours, contact the Stop It Now helpline. We can offer free, confidential support before it’s too late.”

The campaign to boost awareness has been backed by the Internet Watch Foundation (IWF), which proactively tracks down and removes child sexual abuse imagery online.

Dan Sexton, IWF chief technical officer, said: “There is a very real risk we could face a landslide of AI generated child sexual abuse which is completely indistinguishable from real images of children being raped and sexually tortured.

“These new technologies are allowing offenders to mass produce imagery of children who have already suffered abuse in real life, and create imagery of those same children in new scenarios.

“The potential impact for those trying to rid the internet of this material is profound – and the impact on children, who are made victims all over again every time this imagery is shared, is hard to comprehend.

“This is a bleak new front in the war on child sexual abuse imagery, and one which could well get out of control if serious action is not taken now to get a grip on it.”

By Press Association

More Technology News

See more More Technology News

LG AeroCatTower (Martyn Landi/PA)

The weird and wonderful gadgets of CES 2025

Sinclair C5 enthusiasts enjoy the gathering at Alexandra Palace in London

Sinclair C5 fans gather to celebrate ‘iconic’ vehicle’s 40th anniversary

A still from Kemp's AI generated video

Spandau Ballet’s Gary Kemp releases AI generated music video for new single

DragonFire laser weapon system

Britain must learn from Ukraine and use AI for warfare, MPs say

The Pinwheel Watch, a smartwatch designed for children, unveiled at the CES technology show in Las Vegas.

CES 2025: Pinwheel launches child-friendly smartwatch with built in AI chatbot

The firm said the morning data jumps had emerged as part of its broadband network analysis (PA)

Millions head online at 6am, 7am and 8am as alarms go off, data shows

A mobile phone screen

Meta ends fact-checking on Facebook and Instagram in favour of community notes

Mark Zuckerberg

Meta criticised over ‘chilling’ content moderation changes

Apps displayed on smartphone

Swinney voices concern at Meta changes and will ‘keep considering’ use of X

sam altman

Sister of OpenAI CEO Sam Altman files lawsuit against brother alleging sexual abuse as child

OpenAI chief executive Sam Altman with then-prime minister Rishi Sunak at the AI Safety Summit in Milton Keynes in November 2023

OpenAI boss Sam Altman denies sister’s allegations of sexual abuse

A super-resolution prostate image

New prostate cancer imaging shows ‘extremely encouraging’ results in trials

Gadget Show

AI will help workers with their jobs, not replace them, tech executives say

Zuckerberg said he will "work with President Trump to push back on governments around the world that are going after American companies and pushing to censor more”.

Meta’s ‘chilling’ decision to ditch fact-checking and loosen moderation could have ‘dire consequences’ says charity

Twitter logo

X boss Linda Yaccarino praises Meta’s decision to scrap fact checkers

People walk by the Las Vegas Convention Centre

Smart home tech, AI and cars among central themes as CES 2025 prepares to open