AI image generators ‘being used by children to create indecent images’

27 November 2023, 00:04

Online abuse AI algorithm
Online abuse AI algorithm. Picture: PA

The UK Safer Internet Centre said it has started receiving reports from schools of children using AI to create images of other children.

Schoolchildren in the UK are now using AI to generate indecent images of other children, internet safety groups have warned.

The UK Safer Internet Centre (UKSIC) said it has begun receiving reports from schools that children are making, or attempting to make indecent images of other children using AI image generators.

The child protection organisation said such images – which legally constitute child sexual abuse material – could have a harmful impact on children, and warned that it could also be used to abuse or blackmail them.

UKSIC has urged schools to ensure that their filtering and monitoring systems were able to effectively block illegal material across school devices in an effort to combat the rise of such activity.

David Wright, UKSIC director, said: “We are now getting reports from schools of children using this technology to make, and attempt to make, indecent images of other children.

“This technology has enormous potential for good, but the reports we are seeing should not come as a surprise.

“Young people are not always aware of the seriousness of what they are doing, yet these types of harmful behaviours should be anticipated when new technologies, like AI generators, become more accessible to the public.

“We clearly saw how prevalent sexual harassment and online sexual abuse was from the Ofsted review in 2021, and this was a time before generative AI technologies.

“Although the case numbers are currently small, we are in the foothills and need to see steps being taken now, before schools become overwhelmed and the problem grows.

“An increase in criminal content being made in schools is something we never want to see, and interventions must be made urgently to prevent this from spreading further.

“We encourage schools to review their filtering and monitoring systems and reach out for support when dealing with incidents and safeguarding matters.”

In October, the Internet Watch Foundation (IWF), which forms part of UKSIC, warned that AI-generated images of child sexual abuse are now so realistic that many would be indistinguishable from real imagery, even to trained analysts.

The IWF said it had discovered thousands of such images online.

Artificial intelligence has increasing become an area of focus in the online safety debate over the last year, in particular, since the launch of generative AI chatbot ChatGPT last November, with many online safety groups, governments and industry experts calling for greater regulation of the sector because of fears it is developing faster than authorities are able to respond to it.

By Press Association

More Technology News

See more More Technology News

Alexander McCartney, 26, has admitted 185 charges involving 70 children

Online predator who drove 12-year-old catfish victim to suicide to be sentenced after admitting 185 charges

Sewell Setzer III and his mother

Boy, 14, 'killed himself after becoming obsessed with Game of Thrones A.I chatbot'

Meta is set to introduce facial recognition technology to crack down on celebrity advert scams

Facebook and Instagram launch technology to crack down on celebrity scam adverts

Tesla used this AI-Generated image at their We, Robot event

Blade Runner 2049 creators sue Elon Musk over AI-generated Robotaxi images

Mark Zuckerberg speaks about Meta AI during the Meta Connect Conference in California in September

Meta AI tools come to UK for first time

Google Stock

US government says it is considering breaking up Google after competition case

A woman’s hand pressing keys on a laptop keyboard

Lack of digital confidence costing people money and job opportunities – study

A person using a laptop

Government opens new competition to find next generation of cybersecurity talent

Exclusive
Ukrainian military learn to fly drones with bombs attached at a special school on May 12, 2023 in Lviv region Ukraine.

Ukraine’s AI-powered drone swarms signal the future of warfare and 'level the playing field' with Russia, report reveals

Web search page with Google

Google ordered to open app store to rivals by US judge

Appeals Centre Europe is an independent body (PA)

Social media users can appeal over content disputes to new settlement body

A close-up of a group of young people looking at mobile phones

Fear of missing out sees girls stay online despite negativity, survey finds

A close up of copper inside electrical cables

Recycling old cables could help provide copper needed for green tech – study

A woman’s hands on a laptop keyboard.

New regulatory office ‘to help new tech reach public faster’

Woman talking on mobile phone and working on laptop

New AI-powered scam detection tool launches

Google screen

Google brings more AI to search engine in ‘significant’ update