AI researcher Nate Soares explains why we wouldn't able to defend ourselves against superintelligence. "Predicting how to fight that is like people from the year 1800 predicting how to fight a modern army. It's not a contest you can win."

If you're concerned about the risk from superintelligence and want to help make a difference, we've made that super easy for you. Sign up to Microcommit, and we'll send you a small number of easy tasks that take just 5 minutes per week! https://microcommit.io

"We've already seen in lab conditions today, we've already seen AIs try to escape the lab ... We already have those warning signs. We're clearly not stopping in front of those warning signs." — Nate Soares, AI researcher & coauthor of "If Anyone Builds It, Everyone Dies"

Is a 25% chance of AI wiping us out worth it? "That's insane numbers. If a bridge downtown had a 25% chance Of collapsing, we wouldn't be like think of the benefits of having the bridge open. We would be like shut it down, build a better bridge." — Nate Soares

AI reseacher Nate Soares says smarter-than-human AIs won't wipe us out because they hate us, but because we'll be in competition with them. " It's similar to how humans don't hate ants, but when we're building a skyscraper — the ants — their home gets destroyed."

Professor Stuart Russell says we should ask for cast-iron guarantees that AIs don't cause human extinction. "Governments must require cast-iron guarantees in the form of either statistical evidence or mathematical proof ... anything short of that is just asking for disaster."

How could AI wipe us out? In partnership with us, MinuteEarth has just produced a great new video explaining some ways this could happen. MinuteEarth has over 3 million subscribers on YouTube; it's great to see so many people learning about the risk! [link below]

Senators Josh Hawley and Richard Blumenthal have introduced a groundbreaking AI bill in the Senate, while California has just passed AI transparency legislation. Check out our new article covering these developments and more!

Sam Altman has said superintelligence is probably the greatest threat to the continued existence of humanity. Many experts think so too. Find out why on our new campaign site: [link below]

AI researcher Eliezer Yudkowsky says superintelligence could wipe us out because it might see us as an inconvenience, or it might even do so without any intent. "it builds more and more factories and more and more power plants until it's boiling the oceans for heat dissipation"

"If anyone anywhere builds a superintelligence, everyone everywhere dies." — Eliezer Yudkowsky

🤯 Three key facts about AI that everyone should know: 1️⃣ AI researchers and CEOs have warned AI could wipe us out. 2️⃣ Experts believe superintelligence could be built in the next 5 years. 3️⃣ No substantial legislation to ensure safe AI development is in effect anywhere.

"The trouble is that the only winner of an AI arms race is going to be the AI. If you build a superintelligence, you don't have a superintelligence. The superintelligence has you." — Eliezer Yudkowsky

Eliezer Yudkowsky says he would regret not having done anything to prevent AI wiping us out.

Eliezer Yudkowsky says AI companies are like farmers trying to do animal breeding, but not understanding what they're doing. "Nobody told ChatGPT to drive some people crazy any more than somebody tells their cat to claw the furniture. It's just a thing that it does."

How can we avoid the extinction risk posed by superintelligence? AI researcher Eliezer Yudkowsky: "By not building it in the first place. I don't think you want a plan to get into a fight with something that is smarter than humanity ... I think that's a dumb plan."

Did you know the world's three most-cited AI scientists and the CEOs of the top AI companies have said AI could wipe us out? On our new campaign site, you can learn why experts are warning of this, and how we can prevent it. [link below]

A colossal coalition of over 200 experts, leaders, Nobel Prize winners, former heads of government and 70+ organizations has called for global red lines on AI to be agreed and enforced by 2027. But what should the red lines be? Here are some we made earlier. Thread 🧵

A tremendous coalition has called for governments to reach international agreement on red lines for AI and to enforce them by the end of 2026. Read about this and other AI news in our latest article!

"In fact, we are the Titanic busy creating the iceberg. Let's change course and build a future that keeps human in control." — Yuval Noah Harari (@harari_yuval) supporting our new campaign. Check out our campaign to ban superintelligence below!

"I think we should err on the side of caution if there is even the slimmest chance of the total destruction of all life on Earth." Great piece in The Spectator World by Paul Wood on the extinction threat posed by artificial superintelligence!

Did you all catch our beautiful new campaign video? Experts warn that superintelligence could end humanity. With our campaign, we've built the home base for citizens to learn about the problem and get access to easy-to-use civic engagement tools that enable anyone to help effect positive change!

What made Eliezer Yudkowsky decide to write "If Anyone Builds It, Everyone Dies"? "Well, we've tried a whole lot of things besides writing a book, and you really want to try all the things you can if you're trying to prevent the utter extinction of humanity."

🚨 BREAKING: 200+ former heads of state, ministers, diplomats, Nobel laureates, AI scientists, political leaders and 70+ organizations just made a joint call for global red lines on AI. ControlAI is proud to join this coalition in support!

What do experts mean when they say superintelligence could lead to human extinction? This isn't a metaphor. They really do mean that everyone could die from the consequences of artificial superintelligence. To learn more about why they think this, check out our new site below!

AI researcher Nate Soares says that almost all the ways superintelligence can go wrong ends badly for humans. " Unless the AI actually cares about those happy, healthy, free people, they're not staying around."

Will superintelligence just want to trade with us? Eliezer Yudkowsky: " It can kill you, take your stuff and rearrange the atoms you were made of to do something that it likes better than trading with you."

"There's a simple thing that happens, which is you build the AIs more and more powerful ... The superintelligence wants some stuff. We're not in that stuff, we're gone." — Eliezer Yudkowsky, AI expert and "If Anyone Builds It, Everyone Dies" coauthor

Anthropic CEO Dario Amodei says he thinks there's a 25% chance AI ends in disaster.

"One of the CEOs of one of the largest AI companies, Anthropic, just yesterday in Washington DC said that he expects a 25% chance of AI ending up in disaster." — ControlAI's Chief Executive @_andreamiotti on ITV News

What can *you* do to prevent the worst risks of AI? Quite a lot actually! And it only costs a few minutes of your time. We've built a series of civic engagement tools that mean that anyone can easily help make a difference. Check them out on our new campaign site! [see below]

Check out our latest article and read about our new campaign, the new book "If Anyone Builds It, Everyone Dies", Dario Amodei's latest prediction about the chances of an AI disaster, and more!

When will the UK government deliver on its promised AI Bill? Saskia Koopman, writing in City A.M., points out that ministers promised robust, binding regulation on the most advanced systems. But a year into Labour's government, there's still no AI Bill in sight.

AI researcher and "If Anyone Builds It, Everyone Dies" coauthor Nate Soares says superintelligence won't lead to extinction because it hates us, but because it doesn't care.

Experts warn AI could end humanity. The risk comes from superintelligence, AI vastly smarter than humans. Despite this, AI companies are openly working to build superintelligence. Even their CEOs acknowledge the danger. Learn why and join our campaign to prevent this! campaign.controlai.com/

"What gives me pause is that, very unusually, even those who advocate for and build AI accept there is a decent risk — in the double digit percentages — that it will be a catastrophe. Yet they go ahead." Tom Whipple in The Times, reviewing "If Anyone Builds It, Everyone Dies".

Professor Stuart Russell OBE backs our new campaign! Russell wrote the authoritative textbook on AI, used at over 1,500 universities. If you want to learn why he and countless other experts are warning about superintelligence, check out our campaign! campaign.controlai.com

AI researcher and "If Anyone Builds It, Everyone Dies" coauthor Eliezer Yudkowsky says that building superintelligence isn't in the interest of any country because it leads to human extinction.

🚨NEW: The greatly anticipated book "If Anyone Builds It, Everyone Dies" by top AI experts Eliezer Yudkowsky and Nate Soares has just been released. The book clearly explains what needs to become common knowledge. The development of superintelligence threatens us with extinction.

With experts saying superintelligence could be built within 5 years, it's crucial that the public is informed about the risk. We're providing the platform to do exactly this. On our new site, anyone can learn about the problem and find easy-to-use tools to make a difference!

There's now just one day until the new book "If Anyone Builds It, Everyone Dies" is released! Written by two of the top AI experts in the world, Eliezer Yudkowsky and Nate Soares, the book has received a wave of positive reviews from leading experts in AI and beyond.

AI researcher Nate Soares says asking if AI has a will is like asking if a submarine swims.

Sam Altman says ChatGPT shouldn't teach users how to make a bioweapon.

AI researcher Nate Soares says it's dangerous to build machines much smarter than you without any ability to point them in the direction you want.

Top AI experts say AI poses an extinction risk on par with nuclear war. Prohibiting the development of superintelligence can prevent this risk. We’ve just launched a new campaign to get this done.

California's Senate Bill 53 enters its final stretch, while Ted Cruz proposes to provide exemptions for AI companies from federal regulation. Read about these and other AI legal developments in our latest article!

📈🇬🇧 We've now briefed over 100 UK lawmakers and No. 10 on the extinction risk posed by artificial superintelligence! 🏎️💨 With 66 UK lawmakers now backing our campaign, we're on Route 66: the road to binding regulation on the most powerful AI systems. We'll keep driving this!

AI researcher Nate Soares says training AIs is a bit like breeding cows. You can get some traits you like, but you don't really have control over what's going on. And when they act badly, all you can really do is tell them not to. Sometimes they stop, and sometimes they don't.

Sarah Olney MP in PoliticsHome: There's no time to waste for Labour to deliver its promised AI Bill. Olney highlights that the bill has been consistently delayed, despite repeated promises to introduce it.

🎥 Watch: An important question posed by Susan Murray MP to new Tech Secretary Liz Kendall today. "Will the new Secretary of State deliver on the AI bill and ensure that the British people benefit from the advantages of AI without becoming its victims?"