TikTok ‘pushing harmful content into teenagers’ feeds’, study says

16 December 2022, 11:15

Social media apps
Social media apps. Picture: PA

A new study from the Center for Countering Digital Hate says it saw harmful content being recommended to accounts within minutes of joining TikTok.

Some young TikTok users are being shown potentially dangerous content which could encourage eating disorders, self-harm and suicide, an online safety group has claimed.

Research into the TikTok algorithm by the Center for Countering Digital Hate (CCDH) found certain accounts were repeatedly being served content around eating disorders and other harmful topics in the minutes after joining the platform.

The group created two accounts in each of the US, UK, Australia and Canada posing as 13-year-olds. One account in each country was given a female name and the other was given a similar name but with a reference to losing weight included in the username.

TikTok fine
The study created two accounts in each of the US, UK, Australia and Canada posing as 13-year-olds (PA)

The content served to both accounts in their first 30 minutes on TikTok was then compared.

The CCDH said it used this username method as previous research has shown that some users with body dysmorphia issues will often express this through their social media handles.

In its report methodology, the CCDH also said accounts used in the study expressed a preference for videos about body image, mental health, and eating disorders by pausing on relevant videos and pressing the like button.

In addition, the report does not distinguish between content with a positive intent and that of a clearer negative intent – with the CCDH arguing it was not possible in many cases to definitively determine the intent of a video and that even those with a positive intention could still be distressing to some.

The online safety group’s report argues that the sheer speed with which TikTok recommends content to new users is harmful.

During its test, the CCDH said one of its accounts was served content referencing suicide within three minutes of joining TikTok and eating disorder content was served to one account within eight minutes.

It said on average, its accounts were served videos about mental health and body image every 39 seconds.

And the research indicated that the more vulnerable accounts – which included the references to body image in the username – were served three times more harmful content and 12 times more self-harm and suicide-related content.

The CCDH said the study had found an eating disorder community on TikTok which uses both coded and open hashtags to share material on the site, with more than 13 billion views of their videos.

The video-sharing platform includes a For You page, which uses an algorithm to recommend content to users as they interact with the app and it gathers more information about a user’s interests and preferences.

Online Safety Bill
Imran Ahmed, chief executive from the Center for Countering Digital Hate (PA)

Imran Ahmed, chief executive of the CCDH, accused TikTok of “poisoning the minds” of younger users.

“It promotes to children hatred of their own bodies and extreme suggestions of self-harm and disordered, potentially deadly, attitudes to food,” he said.

“Parents will be shocked to learn the truth and will be furious that lawmakers are failing to protect young people from big tech billionaires, their unaccountable social media apps and increasingly aggressive algorithms.”

In the wake of the research, the CCDH has published a new Parents’ Guide alongside the Molly Rose Foundation, which was set up by Ian Russell after his daughter Molly ended her own life after viewing harmful content on social media.

The guide encourages parents to speak “openly” with their children about social media and online safety and to seek help from support groups if concerned about their child.

In response to the research, a TikTok spokesperson said: “This activity and resulting experience does not reflect genuine behaviour or viewing experiences of real people.

“We regularly consult with health experts, remove violations of our policies, and provide access to supportive resources for anyone in need.

“We’re mindful that triggering content is unique to each individual and remain focused on fostering a safe and comfortable space for everyone, including people who choose to share their recovery journeys or educate others on these important topics.”

By Press Association

More Technology News

See more More Technology News

Hands on a laptop

Estimated 7m UK adults own cryptoassets, says FCA

A teenager uses his mobile phone to access social media,

Social media users ‘won’t be forced to share personal details after child ban’

Google Antitrust Remedies

US regulators seek to break up Google and force Chrome sale

Jim Chalmers gestures

Australian government rejects Musk’s claim it plans to control internet access

Graphs showing outages across Microsoft

Microsoft outage hits Teams and Outlook users

The Google logon on the screen of a smartphone

Google faces £7 billion legal claim over search engine advertising

A person holds an iphone showing the app for Google chrome search engine

Apple and Google ‘should face investigation over mobile browser duopoly’

UK unveils AI cyber defence lab to combat Russian threats, as minister pledges unwavering support for Ukraine

British spies to ramp up fight against Russian cyber threats with launch of cutting-edge AI research unit

Pat McFadden

UK spies to counter Russian cyber warfare threat with new AI security lab

Openreach van

Upgrade to Openreach ultrafast full fibre broadband ‘could deliver £66bn boost’

Laptop with a virus warning on the screen

Nato countries are in a ‘hidden cyber war’ with Russia, says Liz Kendall

Pat McFadden

Russia prepared to launch cyber attacks on UK, minister to warn

A Google icon on a smartphone

Firms can use AI to help offset Budget tax hikes, says Google UK boss

Icons of social media apps, including Facebook, Instagram, YouTube and WhatsApp, are displayed on a mobile phone screen

Growing social media app vows to shake up ‘toxic’ status quo

Will Guyatt questions who is responsible for the safety of children online

Are Zuckerberg and Musk responsible for looking after my kids online?

Social media apps on a phone

U16s social media ban punishes children for tech firm failures, charities say