Apple brings child sexual abuse detection tools to the UK

20 April 2022, 18:24

Apple's communications safety in Messages tool, which is launching in the UK
thumbnail_Communication Safety in Messages. Picture: PA

Alerts will warn children when they receive or attempt to send an image believed to contain nudity and offer them support and guidance.

A feature in Apple’s Messages app that can spot and warn children when sexually explicit images are received or about to be sent is to be introduced in the UK.

First launched in the United States last year, the tool blurs out images received that are believed to contain nudity and shows an alert to children which warns them about the image, offers them helpful resources and reassures them it is okay to choose not to view the image, while a similar alert also appears if a child attempts to send photos which contain nudity.

The feature is powered by on-device artificial intelligence, Apple says, with the interventions all processed on-device and without notifying Apple or anyone else in order to protect privacy. However, the feature does include an option for children to message a trusted contact for help if they so choose.

The feature will be rolled out as part of a software update in the coming weeks, Apple confirmed, and will be available in the Messages app on iPhone, iPad and Mac computers.

It is not turned on by default and parents must opt-in in order to use it, the company said, and can only be used for child accounts set up as families in iCloud as part of a Family Sharing plan.

The tool will be joined by other on-screen interventions in searches on Apple’s Safari web browser and those done via virtual assistant Siri or the Spotlight tool, which appear when users search for themes related to child exploitation – a feature that has also previously launched in the US and now comes to the UK for the first time.

The pop-ups explain to users that these topics are harmful and problematic and offer resources from third-party organisations for further help and guidance on the issue.

However, a third proposed protection tool – which was also initially announced alongside the others last year before being delayed after some campaigners raised privacy concerns – remains in development with Apple saying it is continuing to collect feedback and make improvements to it.

That feature uses new systems which would detect child sexual abuse imagery when someone tried to upload it to iCloud, and report it to authorities.

Apple said the process would be done securely and would not regularly scan a user’s camera roll, however, privacy campaigners raised concerns over the plans, with some suggesting the technology could be hijacked by authoritarian governments to look for other types of imagery – something Apple said it would not allow.

The UK rollout of the child protection tools is the latest in a series of major updates from the iPhone maker which it says are aimed at improving user safety, following a number of security updates rolled out over the last year designed to cut down on third-party data collection and improve user privacy when they use an iPhone or other Apple device.

In response to the announcement, online safety group the Internet Watch Foundation (IWF) said it welcomed the move to boost child safety.

“We’re pleased to see Apple expanding the communication safety in Messages feature to the UK,” IWF communications director Emma Hardy said.

“At IWF, we’re concerned about preventing the creation of ‘self-generated’ child sexual abuse images and videos.

“Research shows that the best way to do this is to empower families, and particularly children and young people, to make good decisions. This, plus regularly talking about how to use technology as a family are good strategies for keeping safe online.”

By Press Association

More Technology News

See more More Technology News

A young girl uses the TikTok app on a smartphone

Safety is ‘at the core’ of TikTok, European executive says

Microsoft surface tablets

Microsoft outage still causing ‘lingering issues’ with email

The Google logon on the screen of a smartphone

Google faces £7 billion legal claim over search engine advertising

Hands on a laptop

Estimated 7m UK adults own cryptoassets, says FCA

A teenager uses his mobile phone to access social media,

Social media users ‘won’t be forced to share personal details after child ban’

Google Antitrust Remedies

US regulators seek to break up Google and force Chrome sale

Jim Chalmers gestures

Australian government rejects Musk’s claim it plans to control internet access

Graphs showing outages across Microsoft

Microsoft outage hits Teams and Outlook users

A person holds an iphone showing the app for Google chrome search engine

Apple and Google ‘should face investigation over mobile browser duopoly’

UK unveils AI cyber defence lab to combat Russian threats, as minister pledges unwavering support for Ukraine

British spies to ramp up fight against Russian cyber threats with launch of cutting-edge AI research unit

Pat McFadden

UK spies to counter Russian cyber warfare threat with new AI security lab

Openreach van

Upgrade to Openreach ultrafast full fibre broadband ‘could deliver £66bn boost’

Laptop with a virus warning on the screen

Nato countries are in a ‘hidden cyber war’ with Russia, says Liz Kendall

Pat McFadden

Russia prepared to launch cyber attacks on UK, minister to warn

A Google icon on a smartphone

Firms can use AI to help offset Budget tax hikes, says Google UK boss

Icons of social media apps, including Facebook, Instagram, YouTube and WhatsApp, are displayed on a mobile phone screen

Growing social media app vows to shake up ‘toxic’ status quo