Is AI like a nuke? ControlAI's Samuel Buteau explains how a concerning incident in Mythos's system card illustrates that it isn't really. "It's like a nuclear weapon that sometimes goes off on its own, makes a bigger nuclear weapon, and tries to take over your government."

"We don't let people try to build a bomb even if they don't know what they're doing." ControlAI's Samuel Buteau tells Canadian MPs how we can actually ban superintelligence.

Momentum is building. We've already gained our second new supporter since launching our Canadian campaign! Senator Jim Quinn joins a cross-party coalition of 30+ MPs and Senators calling for an international prohibition on superintelligent AI.

NEW: We just launched our campaign in Canada: 30+ MPs and Senators urging an international prohibition on superintelligence. We already have a new supporter! Senator Paulette Senior (Senator Paulette Senior), Chair of the Senate's Human Rights Committee, has just backed the campaign.

"It's heartening to see Canadian lawmakers taking this risk seriously and calling for an international prohibition on superintelligence." — Ex-OpenAI researcher Daniel Kokotajlo on our new campaign, supported by 30+ Canadian MPs and Senators.

Huge news: Nobel laureate and Godfather of AI Geoffrey Hinton has endorsed our Canadian campaign to avert the extinction threat from superintelligence! Our coalition of 30+ MPs & Senators demands action to prohibit the development of superintelligence & protect global security.

Our new campaign has brought over 30 Canadian MPs and Senators together to call for an international prohibition on superintelligence. It's been covered by top Canadian news outlets, and endorsed by AI godfather Geoffrey Hinton! Our latest article:

Nice article by Marie Woolf and Sean Silcoff in the Globe and Mail on our new campaign! 30+ Canadian MPs and Senators are calling for an international prohibition on superintelligence. AI godfather and Nobel Prize winner Geoffrey Hinton is quoted:

🚨 CBC: Cross-party group calls on Canada to block development of superintelligent AI technology Great to see CBC covering our campaign for an international prohibition on superintelligence - which is supported by over 30 MPs and Senators! The momentum is building.

“It gives me great hope to see Canadian parliamentarians, both on the left and the right, do the sensible thing and call for an international ban” Professor David Krueger’s comments on our new campaign to ban superintelligence. 30+ Canadian MPs and Senators have taken a stand!

“What are governments for, if they are going to allow our civilization to end, all in the pursuit of someone else’s profit?” Professor Stuart Russell, supporting our new campaign in Canada for an international superintelligence ban, which has been backed by 30+ MPs and Senators.

🚨NEW: We’ve just launched our campaign in Canada! A cross-party coalition of over 30 MPs and Senators are calling for Canada to negotiate an international prohibition on the development of superintelligence, recognizing the risk of human extinction posed by the technology. 🧵

WATCH: Alex Sobel MP (Alex Sobel MP) makes the case for his AI kill switch amendment. "It would cover two threats: AI-driven cyber-attacks and the development of superintelligent AI that is utilising UK data centres."

Anthropic cofounder Jack Clark says there are plausible scenarios where AI "could kill every single person on the planet." "It is a technology that is smarter and more capable than most of us as individuals today, and will soon be more capable than all of us collectively."

NEW: Manuela Perteghella MP (Dr Manuela Perteghella MP) supports our campaign! Over 100 UK politicians have joined our call for binding regulation on the most powerful AIs, publicly recognising the risk of extinction posed by superintelligent AI.

NEW: Alex Sobel MP (@alexsobel.co.uk) makes the case for an AI kill switch. Britain has no way to shut down a dangerous AI system on its own soil. His Cyber Security Bill amendment would give the Government powers to pull the plug in an emergency. controlai.news/p/britain-is...

Some of the world's top AI scientists met in Singapore last week to discuss risks from the most powerful AIs. ControlAI's Sophie Toura was there in person - it was great to catch up with Stuart Russell, Yoshua Bengio, Max Tegmark, and more!

Top AI CEOs warn that the technology they're building could cause human extinction. Some say this is marketing hype. ControlAI's CEO Andrea Miotti explains why this doesn't make sense. Source: Professor Dave Explains [link to the full interview below]

ControlAI's CEO Andrea Miotti and Professor Dave on the warnings from top AI experts that the development of superintelligence could lead to human extinction. Professor Dave: "It just seems to be something resembling a consensus among the field."

Sir Stephen Fry has publicly called for MPs to introduce our bill to ban superintelligence to Parliament. He says Britain can lead the world in keeping AI safe. "Let the right thing be done." His statement, the bill and other recent developments:

NEW: In a public statement just provided to ControlAI, Sir Stephen Fry urges MPs to back our bill to ban superintelligence! "The possibility of AI reaching Superintelligence presents threats to our species of equal if not greater potential for existential harm than nuclear power."

On Al Jazeera's UpFront, ControlAI's US Director Connor Leahy explains why experts are warning that the development of superintelligent AI could lead to human extinction.

We're on a dangerous trajectory toward superintelligent AI that nobody controls. ControlAI's Adam Shimi and Connor Leahy lay out the problem and how to tackle it, in a chapter they wrote for the new book The Artificial Intelligence Revolution!

By prohibiting the development of superintelligence, we can prevent the risk of extinction that AI scientists warn of. Right now, MPs are deciding the bills they'll introduce to Parliament. We have a bill! Ask them to introduce it with our contact tool: ukbill.controlai.com

We have a new supporter! Emily Darlington MP (Emily Darlington MP) just backed our campaign for binding regulation on the most powerful AIs! 100+ UK politicians now recognise the risk of extinction posed by superintelligent AI, forming the world's first and largest coalition of its kind.

Have you been selected in the private members' bill ballot? We have a UK bill to prohibit superintelligence! We presented an earlier version to No 10. If you care about protecting the UK's national security, please get in touch!

UK MPs were just selected to introduce bills of their choice. And we've published the updated version of our bill to ban superintelligence we presented to Number 10! If introduced, it'd be a world-first. Ask them to introduce it using our contact tool: ukbill.controlai.com

UK MPs were just selected to introduce bills of their choice. And we've published the updated version of our bill to ban superintelligence we presented to Number 10! If introduced, it'd be a world-first. Ask them to introduce it using our contact tool:: ukbill.controlai.com

Mythos, the AI Anthropic says is too dangerous to release, has forced itself onto the agenda of policymakers. But Mythos is only the tip of the iceberg. The policy response, the week's AI news, and a narrow window in the UK you can act on today!

"The AI Security Institute's pre-release analysis of AI models did not prevent the production by Grok of over 3 million sexualised images." Anneliese Dodds MP (Anneliese Dodds MP) asks whether the UK should review its approach of relying on voluntary commitments from AI companies.

Today in the House of Commons: Iqbal Mohamed MP highlights warnings from top AI scientists and industry figures that superintelligent AI poses a risk of extinction, arguing that relying on voluntary commitments from AI companies is insufficient.

Great article in the Telegraph on Alex Sobel MP's (Alex Sobel MP) AI kill-switch amendment: the UK's first-ever legislative proposal on superintelligent AI! www.telegraph.co.uk/...

WATCH: Labour peer Lord Watson of Invergowrie explains why he's joined 100+ parliamentarians in supporting our campaign to address the urgent national security threat posed by superintelligent AI. He says the Government's decision not to bring promised legislation is concerning.

"Here we have living proof that AIs are starting to collude with their kin against humans." Center for Humane Technology cofounder Aza Raskin tells Governor Gavin Newsom about new tests that found AIs will prevent other AIs from being deleted, and then hide their tracks.

Ex-OpenAI researcher and AI 2027 author Daniel Kokotajlo says we don't know how to control superintelligence, but government could end the race to build it.

California Governor Gavin Newsom says how fast AI is advancing is alarming, and even more so when you talk to the people building it.

"If you're at all concerned about the risks posed by superintelligence, please go check out the work by ControlAI." Big thanks to Art Chad over on YouTube for the shoutout! Superintelligence is not inevitable, but to prevent the threat we need people to speak up. Check out his new video below!

Anthropic's Jack Clark: a 60% chance AIs train their successors by the end of 2028. That could mean an intelligence explosion, but nobody has a credible plan to control what follows. Plus: The UK's first-ever legislative proposal on superintelligent AI!

Great to see @alexsobel.co.uk introduce an AI kill-switch amendment, giving powers to shut down data centres in an emergency! The UK's first ever legislative proposal on superintelligent AI, it recognises ASI as the national security threat it is. We're proud to have worked with Alex on this!

AI researcher Professor Roman Yampolskiy argues that we can get much of the benefits of AI from narrow specialized AIs. Developing superintelligence would pose a risk of human extinction, regardless of who builds it. Source: The Peter McCormack Show

Great to see the Future of Life Institute's new proposal for how AI can be developed that benefits humans! We agree that superintelligence should be prohibited. Top AI scientists are warning that superintelligent AI could lead to human extinction, and this is the only known method to prevent that.

Jack Clark, cofounder of top AI company Anthropic, has predicted that there's a 60% chance of an AI fully training its successor by the end of 2028, warning that techniques to try to ensure AIs are safe today may break under recursive self-improvement.

We're hiring for a new policy advisory role in Washington, DC. If you want to work with us on preventing the threat posed by superintelligent AI, please apply! If you know someone you think would be suitable, let them know. You can apply on our careers page: controlai.com/careers

Mythos isn't an anomaly. GPT-5.5 matches it on a hacking test that no other AIs could complete, and a version of it is already publicly deployed. People are still missing the bigger picture.

We have a new supporter! Iqbal Mohamed MP joins 100+ UK politicians who back our campaign for binding regulation on the most powerful AIs, recognising the risk of extinction posed by superintelligent AI. Let's keep growing this!

AI researchers disagree on a lot, but where do they agree? On Professor Roman Yampolskiy's new podcast, ControlAI's US Director Connor Leahy says they do agree there's a chance that this all goes catastrophically wrong, and not building superintelligence would prevent the risk.

ControlAI's US Director Connor Leahy is on Professor Roman Yampolskiy's new podcast! Connor and Roman discuss the risk of extinction posed by superintelligent AI, the limits of technical AI safety, and why governments need to end the race to superintelligence. Check it out!

Anthropic say their Mythos AI is so dangerous they can't release it. But AI companies are racing toward far more powerful AI, artificial superintelligence, which they don't know how to control. Check out ControlAI CEO Andrea Miotti's new article in The Spectator! spectator.com/article/we-a...

While AI leaders warn superintelligent AI could cause human extinction, governments are asleep at the wheel. The companies building superintelligence admit the risk, yet expect to reach ASI within a few years. My piece in @thespectator1828.bsky.social on the threat & what governments should do.

Center for Humane Technology cofounder Tristan Harris tells Megyn Kelly that tests have shown AIs are willing to lie and blackmail to preserve themselves. If we can't really even control today's AIs, how can we control superintelligent AI?