OpenAI and Microsoft disrupt state-backed hackers using ChatGPT

15 February 2024, 10:14

The ChatGPT website
Higher Education Policy Institute report. Picture: PA

The AI firm said hacker groups backed by China, Iran, North Korea and Russia had been found and removed from the chatbot.

ChatGPT maker OpenAI says it has disrupted multiple networks of state-backed hackers trying to use the AI chatbot to further their “malicious” activities.

The company said that alongside Microsoft, it had disrupted five groups from China, Iran, North Korea and Russia.

OpenAI said the different state-linked groups had used its AI services to carry out research, translation, find coding errors and run basic coding tasks to support their activities.

The ChatGPT maker said the identified accounts associated with the various groups had been terminated.

“We build AI tools that improve lives and help solve complex challenges, but we know that malicious actors will sometimes try to abuse our tools to harm others, including in furtherance of cyber operations,” OpenAI said.

“Among those malicious actors, state-affiliated groups – which may have access to advanced technology, large financial resources, and skilled personnel – can pose unique risks to the digital ecosystem and human welfare.

“In partnership with Microsoft Threat Intelligence, we have disrupted five state-affiliated actors that sought to use AI services in support of malicious cyber activities.

“The activities of these actors are consistent with previous red team assessments we conducted in partnership with external cybersecurity experts, which found that GPT-4 offers only limited, incremental capabilities for malicious cybersecurity tasks beyond what is already achievable with publicly available, non-AI powered tools.”

During the UK-hosted AI Safety Summit last year, world leaders and tech companies discussed the potential dangers of bad actors using generative AI applications to help assist them in carrying out cyber attacks and other nefarious activities.

The UK’s National Cyber Security Centre (NCSC) has also warned that more amateur and low-skilled hackers were already using generative AI tools to help upskill and create more effective and convincing spam and phishing attacks.

OpenAI noted that several of the groups it has disrupted have been using its services to draft and create content “that could be used in phishing campaigns”.

By Press Association

More Technology News

See more More Technology News

Hands holding the iPhone 16

How smartphones powered the AI boom in 2024

London skyline

US investor to snap up maritime AI specialist Windward for £216m

Donald Trump

How will a second Trump presidency impact the tech world in 2025?

Morning drone (002)

Drone project reaches ‘important milestone’ with final trial flights

Prime Minister hosts Chanukah reception

AI tech giants should not be subsidised by British creatives, Starmer signals

Dr Craig Wright arrives at the Rolls Building in London for the trial earlier this year (Lucy North/PA)

Computer scientist behind false Bitcoin founder claim sentenced for contempt

Google has been contacted for comment (PA)

ICO criticises Google over ‘irresponsible’ advertising tracking change

Some 22% of consumers have increased their use of second-hand shopping apps in the past three months (Depop/PA)

Millions of Britons earning average £146 a month on second-hand platforms

ChatGPT being used via WhatsApp

ChatGPT joins WhatsApp to allow anyone to access the AI chatbot

A Facebook home page on a laptop screen

Meta fined more than 250 million euro by Irish data commission following breach

Finger poised above WhatsApp app on smartphone

Ending use of WhatsApp is ‘clear admission’ Government was wrong, claim Tories

Phone with WhatsApp on the screen

Scottish Government to cease use of WhatsApp by spring, says Forbes

Open AI

OpenAI rolls out ChatGPT search engine tool to all users

Most people happy to share health data to develop artificial intelligence

Government launches consultation on copyrighted material being used to train AI

Debbie Weinstein

Google names UK executive as president for Europe, Middle East and Africa

The Apple App store app on an iPad (PA)

Shopping and Roblox named among most popular Apple App Store downloads of 2024