The planet's largest AI summit starts on Monday in India. Will AI safety be on the agenda? Sign our petition to demand that it is. www.change.org/p/ai-summits... #aisafety #aigovernance #artificialintelligence #ai

If and when we'll get AGI, if we do not directly go extinct, one major problem will be how to divide income. AGI and robotics would likely make us all become unemployed.

This Christmas, consider funding a PauseAI volunteer.

MIRI CEO Malo Bourgon explains why AI isn't like other technologies, and why it looks likely that superintelligence will be developed much earlier than previously thought:

So far, most xriskers have felt too good for anti-data center campaigning. We made fun of data center water usage and electricity consumption, even though these are actual problems.

Sometimes, it is hard to believe that this is all real. Are people really building a machine that could be about to kill every living thing on this planet? If this is not true, why are the best scientists in the world saying it is? If this is true, why is no one trying to do anything about it?

If one in ten experts think there is a risk of human extinction when developing a technology, we should not develop this technology, until we are confident that the risk can be almost ruled out.

📢 Event coming up in Amsterdam!📢 Many think we should have an AI safety treaty, but how to enforce it?🤔 Riccardo Varenna from TamperSec has part of a solution: sealing hardware within a secure enclosure. Their proto should be ready within three months. Time to hear more! Be there! lu.ma/v2us0gtr

BREAKING: New experiments by former OpenAI researcher Steven Adler find that GPT-4o will prioritize preserving itself over the safety of its users. Adler set up a scenario where the AI believed it was a scuba diving assistant, monitoring user vitals and assisting them with decisions.

Two weeks ago, Geoffrey Hinton informed a New Zealand audience that AI could kill their children. The presenter announced the part as: "They call it p(doom), don't they, the probability that AI could wipe us out. On the BBC recently you gave it a 10-20% chance".

The closer we get to actual AI, the less people like intelligence, however measured. Passing the Turing test is downplayed now, but passing Marcus' Simpsons test will be downplayed later when it happens, too. Still, AI reaching human level is actually important. We can't keep our heads in the sand.

New paper out!📜🚀 Many think there should be an AI Safety Treaty, but what should it look like?🤔 Our paper starts with a review of current treaty proposals, and then gives its own Conditional AI Safety Treaty recommendations.

Richard Sutton has repeatedly argued that human extinction would be the morally right thing to happen, if AIs were smarter than us. Yesterday, he won the Turing Award from @acm.org. Why is arguing for and working towards extinction fine in AI? youtu.be/pD-FWetbvN8&...

It is hopeful that the British public and British politicians support regulation to mitigate the risk of extinction from AI. Other countries should follow. In the end, a global AI Safety Treaty should be signed.

On the eve of the AI Action Summit in Paris, we proudly announce our AI Safety Debate with Prof. Yoshua Bengio!📢 In the panel: @billyperrigo.bsky.social from Time @kncukier.bsky.social from The Economist Jaan Tallinn from CSER/FLI Emma Verhoeff from @minbz.bsky.social Join here! lu.ma/g7tpfct0

Pretraining may have hit a wall, but AI progress in general hasn't. Progress in closed-ended domains such as math and programming is obvious, and worrying. The public needs to be kept up to date on both increasing capabilities, and obvious misalignment of leading models.

Nobel Prize winner Geoffrey Hinton thinks there is a 10-20% chance AI will "wipe us all out" and calls for regulation. Our proposal is to implement a Conditional AI Safety Treaty. Read the details below. www.theguardian.com/technology/2...

💼 We're hiring a Head of US Policy! ⬇️ 🇺🇸 This opening is an exciting opportunity to lead and grow our US policy team in its advocacy for forward-thinking AI policy at the state and federal levels. ✍ Apply by Dec. 22 and please share: jobs.lever.co/futureof-life/c933ef39-588f-43a0-bca5-1335822b46a6

Peaceful activism from organizations such as @pauseai.bsky.social is a good way to increase pressure on governments. They need to accept meaningful AI regulation, such as an international AI safety treaty.

It is now public knowledge that multiple LLMs significantly larger than GPT-4 have been trained, but they have not performed much better. That means scaling laws have broken down. What does this mean for existential risk?

Today, we propose the Conditional AI Safety Treaty in TIME as a solution to AI's existential risks. AI poses a risk of human extinction, but this problem is not unsolvable. The Conditional AI Safety Treaty is a global response to avoid losing control over AI. How does it work?