World leaders need to ‘get serious’ about AI, experts warn as summit opens

21 May 2024, 02:54

AI safety summit
AI safety summit. Picture: PA

World-leading AI scientists say not enough progress has been made since the last AI Safety Summit, six months ago.

Some of the world’s leading AI scientists have called for stronger action on AI risk from world leaders, as the AI Seoul Summit begins on Tuesday, warning that progress has been insufficient since the first AI Safety Summit in the UK six months ago.

Prime Minister Rishi Sunak will co-host a virtual meeting of world leaders with South Korean president Yoon Suk Yeol on Tuesday to open the summit, where he will say that managing the risks posed by artificial intelligence is “one of the most profound responsibilities” faced by governments.

However, in a new expert consensus paper published in the journal Science, 25 of the world’s leading scientists in the technology say governments are moving too slowly to regulate the rapidly evolving technology and there has not been enough progress since the previous summit.

They argue that world leaders must take seriously the possibility that more powerful general use AI systems – which are capable of regularly outperforming humans – will be developed in the current decade or next, and respond accordingly.

Professor Philip Torr, Department of Engineering Science, University of Oxford, and co-author on the paper, said: “The world agreed during the last AI summit that we needed action, but now it is time to go from vague proposals to concrete commitments.

“This paper provides many important recommendations for what companies and governments should commit to do.”

In the paper, the experts say rapid-response institutions for AI oversight must be established, with far greater funding that many governments currently plan, while also mandating more rigorous risk assessments with enforceable consequences, rather than the current model of voluntary, unspecified evaluations.

The experts include Turing award winners, Nobel laureates, and authors of standard AI textbooks, and hail from major AI powerbases including the UK, US, China and the EU.

Stuart Russell, professor of computer science at the University of California at Berkeley, and author of a textbook on AI, said: “This is a consensus paper by leading experts, and it calls for strict regulation by governments, not voluntary codes of conduct written by industry.

“It’s time to get serious about advanced AI systems. These are not toys. Increasing their capabilities before we understand how to make them safe is utterly reckless.

“Companies will complain that it’s too hard to satisfy regulations — that ‘regulation stifles innovation’. That’s ridiculous. There are more regulations on sandwich shops than there are on AI companies.”

Ahead of the summit, the first iteration of a new scientific report on AI safety – the first of its kind and commissioned at the AI Safety Summit in November – found the experts involved to be uncertain on the technology’s future.

They said that while AI could boost wellbeing, prosperity and scientific research in the future, it could also be used to power widespread disinformation and fraud, disrupt jobs and reinforce inequality.

As well as highlighting the potential benefits and risks, it warns there is not universal agreement among experts on a range of topics around AI, including the state of current AI capabilities and how those could evolve over time, and the likelihood of extreme risks – such as losing control over the technology – occurring.

The interim report is set to be used as a starting point for discussions among world leaders, industry experts, researchers and tech giants at the latest two-day summit in Seoul.

It comes as the pace of innovation in the sector shows no sign of slowing down, with ChatGPT maker OpenAI, Google and Microsoft all announcing swathes of new AI-powered tools and products in the days ahead of the summit.

And another heavyweight in the tech industry, Apple, is due to make its own AI announcements in early June.

By Press Association

More Technology News

See more More Technology News

The Pinwheel Watch, a smartwatch designed for children, unveiled at the CES technology show in Las Vegas.

CES 2025: Pinwheel launches child-friendly smartwatch with built in AI chatbot

The firm said the morning data jumps had emerged as part of its broadband network analysis (PA)

Millions head online at 6am, 7am and 8am as alarms go off, data shows

A mobile phone screen

Meta ends fact-checking on Facebook and Instagram in favour of community notes

Mark Zuckerberg

Meta criticised over ‘chilling’ content moderation changes

Apps displayed on smartphone

Swinney voices concern at Meta changes and will ‘keep considering’ use of X

sam altman

Sister of OpenAI CEO Sam Altman files lawsuit against brother alleging sexual abuse as child

OpenAI chief executive Sam Altman with then-prime minister Rishi Sunak at the AI Safety Summit in Milton Keynes in November 2023

OpenAI boss Sam Altman denies sister’s allegations of sexual abuse

A super-resolution prostate image

New prostate cancer imaging shows ‘extremely encouraging’ results in trials

Gadget Show

AI will help workers with their jobs, not replace them, tech executives say

Zuckerberg said he will "work with President Trump to push back on governments around the world that are going after American companies and pushing to censor more”.

Meta’s ‘chilling’ decision to ditch fact-checking and loosen moderation could have ‘dire consequences’ says charity

Twitter logo

X boss Linda Yaccarino praises Meta’s decision to scrap fact checkers

People walk by the Las Vegas Convention Centre

Smart home tech, AI and cars among central themes as CES 2025 prepares to open

An Apple phone

Apple to update AI tools after BBC complaint over inaccurate news alerts

Meta is ditching its fact-checking service

Meta ditches fact-checking on Facebook and Instagram in favour of X-style 'community notes'

A wallet with bank cards cash

35% of young adults ‘are concerned about their finances on a daily basis’

Broadcaster Cathy Newman at the Women of The Year Lunch and Awards 2019 in London

‘Haunting’ to see deepfake pornography of myself, says journalist Cathy Newman