Tech firms vow to tackle ‘shocking’ AI-generated child sex abuse images

30 October 2023, 17:04

A person using a laptop
Online abuse. Picture: PA

Home Secretary Suella Braverman hosted an event to combat such ‘depraved’ material.

Tech giants including TikTok and Snapchat have signed a pledge vowing to tackle the spread of artificially generated images of child sex abuse.

Home Secretary Suella Braverman hosted the companies, as well as charities, academics and representatives of the UK and Australian governments at an event on Monday to address the “shocking” spread of AI-generated material depicting children being abused.

It comes after an internet safety organisation warned that the realistic imagery risks normalising sexual violence against children.

The images, although computer-generated, are often based on real material, “revictimising” the survivors of that past abuse, the Internet Watch Foundation (IWF) said.

The event, held in partnership with the IWF, was taking place before Rishi Sunak’s AI Safety Summit at Bletchley Park later this week.

Ms Braverman said: “Child sexual abuse images generated by AI are an online scourge. This is why tech giants must work alongside law enforcement to clamp down on their spread. The pictures are computer-generated but they often show real people – it’s depraved and damages lives.

“The pace at which these images have spread online is shocking and that’s why we have convened such a wide group of organisations to tackle this issue head-on. We cannot let this go on unchecked.”

IWF data found that thousands of child sex abuse pictures could be found on the dark web and are realistic enough to be treated as real imagery under UK law.

The organisation, which works to identify and remove online images and videos of child abuse, said the AI-generated material could make it harder to spot when real children might be in danger.

IWF chief executive Susie Hargreaves said: “The realism of these images is astounding, and improving all the time. The majority of what we’re seeing is now so real, and so serious, it would need to be treated exactly as though it were real imagery under UK law.

“It is essential, now, we set an example and stamp out the abuse of this emerging technology before it has a chance to fully take root. It is already posing significant challenges.”

The joint statement signed by tech companies including OnlyFans and Stability AI pledged to sustain “technical innovation around tackling child sexual abuse in the age of AI”, according to the Home Office.

The statement affirms that AI must be developed in “a way that is for the common good of protecting children from sexual abuse across all nations”.

Other signatories included the NSPCC, National Crime Agency and National Police Chiefs’ Council.

The Government is looking into further investment into using AI to combat child sexual abuse.

It already uses the technology to sort through large volumes of data and grade the severity of the material, helping police identify offenders and safeguard children, the Home Office said.

NSPCC chief executive Sir Peter Wanless said: “Already we are seeing AI child abuse imagery having a horrific impact on children, traumatising and retraumatising victims who see images of their likeness being created and shared. This technology is giving offenders new ways to organise and risks enhancing their ability to groom large numbers of victims with ease.

“It was important to see child safety on the agenda today. Further international and cross-sector collaboration will be crucial to achieve safety by design.”

By Press Association

More Technology News

See more More Technology News

Laptop with a virus warning on the screen

Nato countries are in a ‘hidden cyber war’ with Russia, says Liz Kendall

Pat McFadden

Russia prepared to launch cyber attacks on UK, minister to warn

A person holds an iphone showing the app for Google chrome search engine

Apple and Google ‘should face investigation over mobile browser duopoly’

A Google icon on a smartphone

Firms can use AI to help offset Budget tax hikes, says Google UK boss

Icons of social media apps, including Facebook, Instagram, YouTube and WhatsApp, are displayed on a mobile phone screen

Growing social media app vows to shake up ‘toxic’ status quo

Will Guyatt questions who is responsible for the safety of children online

Are Zuckerberg and Musk responsible for looking after my kids online?

Social media apps on a phone

U16s social media ban punishes children for tech firm failures, charities say

Google shown on a smartphone

US Government proposes forcing Google to sell Chrome to break-up tech empire

The logo for Google's Gemini AI assistant

Google’s Gemini AI gets dedicated iPhone app in the UK for the first time

Facebook stock

EU fines Meta £660m for competition rule breaches over Facebook Marketplace

A phone taking a photo of a phone mast

Government pledges more digital inclusion as rural Wales gets phone mast boost

Social media apps displayed on a mobile phone screen

What is Bluesky and why are people leaving X to sign up?

Someone types at a keyboard

Cyber security chief warns Black Friday shoppers to be alert to scams

MPs

Ministers pressed on excluding Chinese firms from UK’s genomics sector

Child with mobile phone stock

Specially designed smartphone for children launches in the UK

Roblox on a laptop

Children’s gaming platform Roblox makes ‘major update’ to parental controls