AI image generators ‘being used by children to create indecent images’

27 November 2023, 00:04

Online abuse AI algorithm
Online abuse AI algorithm. Picture: PA

The UK Safer Internet Centre said it has started receiving reports from schools of children using AI to create images of other children.

Schoolchildren in the UK are now using AI to generate indecent images of other children, internet safety groups have warned.

The UK Safer Internet Centre (UKSIC) said it has begun receiving reports from schools that children are making, or attempting to make indecent images of other children using AI image generators.

The child protection organisation said such images – which legally constitute child sexual abuse material – could have a harmful impact on children, and warned that it could also be used to abuse or blackmail them.

UKSIC has urged schools to ensure that their filtering and monitoring systems were able to effectively block illegal material across school devices in an effort to combat the rise of such activity.

Young people are not always aware of the seriousness of what they are doing, yet these types of harmful behaviours should be anticipated when new technologies, like AI generators, become more accessible to the public

David Wright, UKSIC

David Wright, UKSIC director, said: “We are now getting reports from schools of children using this technology to make, and attempt to make, indecent images of other children.

“This technology has enormous potential for good, but the reports we are seeing should not come as a surprise.

“Young people are not always aware of the seriousness of what they are doing, yet these types of harmful behaviours should be anticipated when new technologies, like AI generators, become more accessible to the public.

“We clearly saw how prevalent sexual harassment and online sexual abuse was from the Ofsted review in 2021, and this was a time before generative AI technologies.

“Although the case numbers are currently small, we are in the foothills and need to see steps being taken now, before schools become overwhelmed and the problem grows.

An increase in criminal content being made in schools is something we never want to see, and interventions must be made urgently to prevent this from spreading further

David Wright, UKSIC

“An increase in criminal content being made in schools is something we never want to see, and interventions must be made urgently to prevent this from spreading further.

“We encourage schools to review their filtering and monitoring systems and reach out for support when dealing with incidents and safeguarding matters.”

In October, the Internet Watch Foundation (IWF), which forms part of UKSIC, warned that AI-generated images of child sexual abuse are now so realistic that many would be indistinguishable from real imagery, even to trained analysts.

The IWF said it had discovered thousands of such images online.

Artificial intelligence has increasing become an area of focus in the online safety debate over the last year, in particular, since the launch of generative AI chatbot ChatGPT last November, with many online safety groups, governments and industry experts calling for greater regulation of the sector because of fears it is developing faster than authorities are able to respond to it.

By Press Association

More Technology News

See more More Technology News

Studio

University launches multi-million pound creative industry studio

Disposable vapes of varying flavours on sale in a store

Campaign to warn teenagers about vaping addiction

Signage on the side of an Uber car

Meta and Uber among firms ‘linked’ to alleged corporate migrant worker abuse

The X logo is seen on a smartphone screen

Irish Independent publisher takes legal action against X over ‘fake ads’

Elon Musk

Police quash claims armed ‘migrant mob’ stormed hospital after Elon Musk reposts fake AI-generated image

A DeepSeek page seen on a smartphone screen

DeepSeek accused of sharing user data with TikTok owner ByteDance

(L to R) Napier AI boss Greg Watson, Economy Minister Caoimhe Archibald and Invest NI chief Kieran Donoghue in Belfast

London AI firm announces 106 jobs for Belfast

A man lying in bed, looking tired

Scientists develop smart pyjamas to monitor sleep conditions at home

E-scooters are currently illegal to use on the public highways including pavements.

E-scooters blamed for 'shocking' surge in uninsured teen riders with 2,000% increase in offences

Elon Musk speaks during an event in the Oval Office at the White House

Elon Musk’s xAI unveils Grok 3 model to take on ChatGPT and Google Gemini

A child’s hand pressing a key of a laptop keyboard

Children will be ‘left exposed to sexual abuse online under current safety rules’

Sophie Winkleman

Sophie Winkleman calls for AI to be kept out of classrooms

DeepSeek logo on a phone

DeepSeek usage a ‘personal choice’ for public, Government says

Technology

Community Fibre broadband service restored after outage

Skyrora, a rocket company with its headquarters in Edinburgh

Scottish company promises to blast rockets into space from 2026

Lights on the front panel of a broadband internet route

Community Fibre ‘working on solution’ to broadband outage