Frontier AI systems could surpass most individuals across most cognitive tasks within just a few years. These advances could unlock solutions to major global challenges, but they also carry significant risks. To safely advance toward superintelligence, we must scientifically determine how to design AI systems that are fundamentally incapable of harming people, whether through misalignment or malicious use. We also need to make sure the public has a much stronger say in decisions that will shape our collective future.

To get the most from what AI has to offer mankind, there is simply no need to reach for the unknowable and highly risky goal of superintelligence, which is by far a frontier too far. By definition this would result in a power that we could neither understand nor control.

AI offers extraordinary promise to advance human rights, tackle inequality, and protect our planet, but the pursuit of superintelligence threatens to undermine the very foundations of our common humanity. We must act with both ambition and responsibility by choosing the path of human-centred AI that serves dignity and justice.

We should rapidly develop powerful AI tools that help cure diseases and solve practical problems, but not autonomous smarter-than-human machines that nobody knows how to control. Creating superintelligent machines is not only unacceptably dangerous and immoral, but also completely unnecessary.

The future of AI should serve humanity, not replace it. The true test of progress will be not how fast we move, but how wisely we steer.

Yeah, we want specific AI tools that can help cure diseases, strengthen national security, etc. But does AI also need to imitate humans, groom our kids, turn us all into slop junkies and make zillions of dollars serving ads? Most people don’t want that. But that’s what these big tech companies mean when they talk about building ‘Superintelligence’.

This is not a ban or even a moratorium in the usual sense. It’s simply a proposal to require adequate safety measures for a technology that, according to its developers, has a significant chance to cause human extinction. Is that too much to ask?

If we race to build superintelligence without clear and morally informed parameters, we risk undermining the incredible potential AI has to alleviate suffering and enable flourishing. We should intentionally harness this amazing technology to help people, not rush to build machines and mechanisms we cannot control.

Superintelligence would likely break the very operating system of human civilization - and is completely unnecessary. If we instead focus on building controllable AI tools to help real people today, we can far more reliably and safely realize AI’s incredible benefits.

When AI researchers warn of extinction and tech leaders build doomsday bunkers, prudence demands we listen. Superintelligence without proper safeguards could be the ultimate expression of human hubris—power without moral restraint.

We won't realize AI's promising potential to improve human life, health, and prosperity if we don’t account for the risks. Developers and policymakers must consider the potential danger of artificial superintelligence raised by these leading thinkers.

Development of superhuman machine intelligence (SMI) is probably the greatest threat to the continued existence of humanity.

I think there’s a 25% chance that things go really, really badly

Until we can prove unequivocally that it is [safe], we shouldn’t be inventing it.

AI is a wonderful tool for the betterment of humanity. AGI is a potential successor species.

I think the probability of a good outcome is like 80% likely ... only 20% chance of annihilation.

Emeritus Professor of Computer Science

Geoffrey Hinton

Professor of Computer Science

Yoshua Bengio

Stuart Russell

Co-founder of Apple

Steve Wozniak

Founder

Sir Richard Branson

Steve Bannon

Founder of Blaze media, radio host, TV personality, political commentator

Glenn Beck

Susan Rice

Mike Mullen

Former Congressman (D) representing  New York and House Democratic Caucus Chair

Joe Crowley

Former Congressman (D) representing New York 

Gary Ackerman

Former Congressman (D) representing New York

Brian Higgins

Steve Israel

Former Congressman (R) representing Pennsylvania 

Keith Rothfus

Former Congressman (D) representing Colorado

Ed Perlmutter

Former Congressman (D) representing Kentucky

John Yarmuth

Fmr President of Ireland; Fmr UN High Commissioner for Human Rights

Mary Robinson

Fmr President of Estonia

Kersti Kaljulaid

I feel like we are creating a nuclear bomb and marketing it for home use. Or maybe giving blobs of mercury for kids to play with. Nor sure we should really. If still possible, we should exercise all necessary caution.

Co- Founder

Prince Harry, Duke of Sussex

Meghan, Duchess of Sussex

Fmr Director of AI Strategy and Policy

Mark Beall

Fmr UK Defence Minister, Member of the UK House of Lords

Desmond Browne, Lord Browne of Ladyton

Emad Mostaque

Vice-chair

Andre Hoffman

Fmr Special Assistant to the President for National Security Affairs

Jon Wolfsthal

The discussion over AGI should not be cast as a struggle between so called doomers and optimists. AGI presents a common challenge for all of humanity. We must to ensure we control technology and it does not control us. Until and unless developers and their funders know that a technology with the capacity to be smarter, faster, stronger and just as lethal as humanity cannot escape human control, it must not be unleashed. Ensuring we can enjoy the benefits of AI and AGI requires us to be responsible in its development.

CEO, Zhipu AI

Peng Zhang (张鹏)

Professor & Dean

Andrew Yao (姚期智)

AI techonologies, no matter how powerful and spendid they get, must always remain firmly a human-directed instrument.

Chair Professor & Dean

Ya-Qin Zhang (张亚勤)

While the rapid advance in frontier AI models can profoundly benefit humanity, it also introduces significant unknown risks. It is dangerous, irresponsible and unnecessary to race for superintelligence without a solid foundation on controllability, dependability and safety.

Dean

Lan Xue (薛澜)

Yi Zeng (曾毅)

Until now, we do NOT have scientific evidence and practical way to keep Superintelligence safe enough NOT to bring catastrophic risks for human. The World has NOT been ready to welcome Superintelligence NOT as a tool that is controlable at this point.

Papal AI advisor, Catholic priest

Paolo Benanti

Senior Fellow

Christine Rosen

President

Johnnie Moore

Walter Kim

Associate General Secretary

Anthony J. Granado

General Secretary

Kelly (Monroe) Kullberg

Gabriel Salguero

CEO and Founder

Timothy W. Estes

Global AI Ambassador, Chief Web Advocate

Nnenna Nwakanma

Author and Professor

Yuval Noah Harari

Institute Professor

Daron Acemoğlu

Nobel Laureate in Physics, senior astrophysicist at NASA

John Mather

Nobel Laureate in physics, Professor of Physics

Frank Wilczek

Beatrice Fihn

Professor

Martin Rees

Member of the European Parliament,  AI Act Rapporteur

Brando Benifei

Member of the European Parliament

Michael McNamara

Markéta Gregorová

Fmr UK Minister for AI and Intellectual Property, Member of the UK House of Lords

Jonathan Berry, Viscount Camrose

Fmr Labour Party whip in the House of Lords, Member of the UK House of Lords

Leslie Griffiths, Lord Griffiths of Burry Port

Member of the UK House of Commons

Ben Lake

Alex Sobel

Lord Fairfax of Cameron, Member of the House of Lords

Nicholas Fairfax

Fmr UK Minister of State for Energy, Member of the UK House of Lords

Philip Hunt, Lord Hunt of Kings Heath OBE

Member of the UK House of Lords

James Knight, Lord Knight of Weymouth

Paul Strasburger, Lord Strasburger

Beeban Kidron, Baroness Kidron OBE

Actor, Filmmaker

Joseph Gordon-Levitt

Actor, director, writer

Sir Stephen Fry

Rapper, singer, producer, actor

Will.I.am

Philosopher

Peter Albert David Singer

President & CEO

Valerie Pisano

Managing Director and CEO

Jimena Sofia Viveros Alvarez

Senior Advisor on Public Policy and Ethics

Devan Patel

Jaan Tallinn

Vincent Conitzer

Professor of Computational Engineering

Moshe Y. Vardi

Associate Professor of Computer Science

Sharon Li

Assistant Professor of Computer Science

Freda Shi

Distinguished Professor of Computer Science

Pierre Baldi

Musician

Kate Bush

Professor & Canada CIFAR AI Chair

Adam Oberman

Assistant Professor, Faculty of Artificial Intelligence and Decision-Making

Dylan Hadfield-Menell

Professor of Physics

Max Tegmark

Executive Director

Anthony Aguirre

Co-founder, Future of Life Institute

Meia Chita-Tegmark

Victoria Krakovna 

Dan Hendrycks

Tristan Harris

Nate Soares

The race to superintelligence is suicidal. Progress shouldn't be subjected to a public veto, but technologists also shouldn't flirt with annihilation. Scientific consensus alone is not enough (any more than alchemist consensus in the year 1100 would be enough to guarantee a potion of immortality). The science of making a superintelligence beneficial is nowhere near mature. There's time pressure and reality may demand bold action from cognizant leaders (without public buy-in), but the public is right to object to the race and right to be wary of technologist consensus in this case.

Malo Bourgon

Co-founder and CEO

Connor Leahy

Founder and CEO

Andrea Miotti

Interim Executive Director

Mark Nitzberg

Charbel-Raphaël Segerie

Jeffrey Ladish

Nicolas Moës

Asst. Professor in Machine Learning

David Krueger

Assistant Professor

Qian Tao

Co-founder and CTO

Gabriel Alfour

Assistant Professor in Machine Learning

Tegan Maharaj

Artist

Grimes

Actor

Jim Sturgess

Zvi Mowshowitz

Audrey Tang

Asst. Professor of Computer Science

Anqi Liu

George Church

Clark Barrett

Professor of Mathematical Statistics

Olle Häggström

Associate Professor/Deputy Director

Sally Shrapnel

Hi there,

I just signed the Statement on Superintelligence and want to invite you to join me in calling for a prohibition on the development of superintelligence, until there's broad scientific consensus that it will be done safely and controllably, and with strong public buy-in.

https://superintelligence-statement.org

<p><strong>Contexto</strong>: Ferramentas inovadoras de IA podem trazer saúde e prosperidade sem precedentes. No entanto, além das ferramentas, muitas empresas líderes em IA têm o objetivo declarado de desenvolver uma superinteligência na próxima década que possa superar significativamente todos os humanos em praticamente todas as tarefas cognitivas. Isso tem levantado preocupações, que vão desde a obsolescência econômica e a perda de poder humano, perdas de liberdade, liberdades civis, dignidade e controle, até riscos à segurança nacional e até mesmo a potencial <a target="_blank" href="https://safe.ai/work/statement-on-ai-risk">extinção humana</a>. A sucinta declaração abaixo visa tornar público o crescente número de especialistas e figuras públicas que se opõem à corrida pela superinteligência.</p><div class="readmore"></div>

“Pedimos a proibição do desenvolvimento da superinteligência, que não deve ser suspensa antes que haja: 1. amplo consenso científico de que isso será feito de forma segura e controlável, e 2. forte adesão pública.”

Declaração sobre Superinteligência

Website preview: Statement on Superintelligence

I just signed the Statement on Superintelligence. 
Let's take the future back from Big Tech. Join me in calling for a prohibition on the development of superintelligence. #KeepTheFutureHuman
https://superintelligence-statement.org

Principais resultados da pesquisa sobre Superinteligência

Pedimos a proibição do desenvolvimento da superinteligência, que não deve ser suspensa antes que haja