Instagram vows to remove accounts of people who send abusive direct messages

10 February 2021, 12:54

Romaine Sawyers, Lauren James, Reece James and Axel Tuanzebe
Romaine Sawyers, Lauren James, Reece James and Axel Tuanzebe have all been targeted recently (PA). Picture: PA

Facebook content policy manager Fadzai Madzingira told the PA news agency she was ‘horrified’ at the abuse footballers have to deal with.

Instagram has announced new measures to tackle online abuse in the wake of the latest spate of sickening racist attacks on footballers.

Manchester United players Anthony Martial, Marcus Rashford, Axel Tuanzebe and Lauren James are among those to have been subjected to racism on social media in the last fortnight alone.

A man was arrested during that period after Romaine Sawyers was sent what West Brom called an “abhorrent message”, while Chelsea full-back Reece James – brother of Lauren – was sent vile abuse via an Instagram direct message.

Instagram does not use technology to proactively detect content within private messages but it has announced new measures, including removing abusive accounts, in a bid to reduce the abuse people get in direct messages.

Facebook content policy manager Fadzai Madzingira told the PA news agency: “I am horrified that they have to deal with that sort of abuse and as a company we take it very seriously.

“We’ve always had rules around people who abuse our community standards in Instagram direct messaging, specifically.

“Currently we will set a specific ban or what we call a block for a set amount of time when someone violates those rules and we extend that time should they continue to do so.

“What we’re announcing today is that we’re taking tougher measures on people who violate those rules in Instagram direct messaging, so instead of just extending the time, we’ll be removing the accounts altogether.

“That allows us to ensure that we have a lower tolerance for that sort of abuse in direct messaging and we’ll be closing those accounts more quickly in Instagram direct messaging than anywhere else on the platform.”

Stopping individuals from seeing abusive content in direct messages is challenging, given they are private conversations, but business and creator accounts have the option to turn off messages from people they do not know.

Instagram intends to eventually roll that function out to all personal accounts, while a new feature is in the works recognising “that seeing abusive DMs in the first place takes a toll”.

But vile abuse has not been restricted to private messages, with a number of players seeing monkey emojis and racist terms left in the comment section of recent posts.

A number of those accounts appear to be focused on sending abuse – something Ms Madzingira says Instagram continues to work on, while she pointed to comment filters that can block certain words, phrases and emojis from appearing.

“I think there is something about the world that we’re living in where someone can go from throwing a banana peel at a player on the pitch to suddenly also waking up and opening their accounts and using this online,” she said.

“What we’re trying to address is the online aspect but there’s definitely a broader conversation we need to have about what does racism in sport look like and how do we stop that sort of behaviour?”

Instagram says it took action on 6.5 million pieces of hate speech, including in direct messages, between July and September of last year, with 95% found before anyone had reported it.

The social media platform has underlined its commitment to working with UK law enforcement on such abuse, vowing to respond to valid legal requests for information.

Preventing people from hiding behind anonymous accounts has been repeatedly mentioned within football as a way of holding people to account for abuse.

Asked if backend identification was feasible, Ms Madzingira said: “I personally understand where the frustration comes from and the desire for people to ‘need to use government IDs before they can open an account’.

West Bromwich Albion v Fulham – Premier League – The Hawthorns
Romaine Sawyers was recently sent what West Brom called an ‘abhorrent message’ (Paul Childs/PA)

“It is a debate we’ve had internally. There are a lot of difficulties – and not on a cost side – a lot of difficulties in terms of access when you think about who has identification and who doesn’t.”

Ms Madzingira pointed to the example of how difficult it was to get hardcopy identification growing up in Zimbabwe, as well as the disproportionate impact on other groups.

She knows there is a lot more to do and welcomes the ongoing discussions with all relevant stakeholders, including discussions with the UK Government on the Online Harms Bill.

“As a company, we’ve been really open,” Ms Madzingira said. “We want to have these conversations with governments. We want to be talking about regulation.

“We do think we’re not just talking about online, we’re talking about some of the behaviour offline and how it presents itself online.

“We think regulation is the appropriate discussion to be having right now.”

And Instagram has vowed to continue dialogue with football bodies about how to curb abuse.

The social media network said in a statement: “We’re committed to doing everything we can to fight hate and racism on our platform, but we also know these problems are bigger than us.

“We look forward to working with other companies, football associations, NGOs, governments, parents and educators, both on and offline.”

By Press Association

More Technology News

See more More Technology News

TikTok on a smartphone

TikTok to begin appeal against possible US ban

The Darktrace wesbite

Darktrace set to leave London Stock Exchange at end of September

An unidentified hacker in dark hoodie performing at a comupter

UK convenes nations for talks on global cybersecurity

Icons of social media apps, including Facebook, Instagram, YouTube and WhatsApp, are displayed on a mobile phone screen

Meta to begin training AI on public posts from UK Facebook and Instagram users

JLR Rover the Boston Dynamics robot dog (JLR/PA)

JLR’s new ‘Rover’ is a robotic dog employed to protect brand’s EV facility

The logo and name of the technology company OpenAI on a smarthpone

OpenAI unveils new models designed to think more before answering

A person looking at a mobile phone whose screen has been blurred

Government strengthens Online Safety Act to crack down on revenge porn

Vodafone and Three logos

Vodafone and Three merger could increase phone bills for millions, watchdog says

A mobile phone mast being photographed by a mobile phone

6G network at least a decade away, expert says

A sign for the London underground in central London.

Teenager arrested over Transport for London cyber attack

Cyber security

BT ‘logs 2,000 signals of potential cyber attacks every second’

ChatGPT website with pink lettering displayed on a screen

OpenAI in talks to raise funds at £115bn valuation – reports

Person typing on a laptop

UK data centres to be designated as ‘critical infrastructure’

A plaque outside the offices of the Data Protection Commission in Dublin

Irish watchdog launches probe into Google’s AI model

The technology giant said the growth of cloud computing and artificial intelligence was key to the increasing investment (Niall Carson/PA)

Amazon Web Services ‘to invest £8bn in UK over next five years’

The hands of a person on a laptop keyboard

Most people have no plan for digital assets upon death, Which? warns