Two new recordings from TIAP 2026 are now live: ▸ Fireside Chat with Anne Neuberger: AI and National Security ▸ Dominic Rizzo - Silicon Roots of Trust: Attestation You'd Want Even If Nobody Required It 👇

“Fault free oversight requires intimate contact with failure”. Sarah Schwettmann builds tools for better scalable oversight of AI systems, by going beyond learning from human preferences to training agents to keep track of how close a system is to failure.👇

@sleepinyourhat just presented the first misalignment safety case from a frontier AI lab, analyzing Claude Opus 4: a 6 month effort that covered 9 pathways to catastrophic harm.👇

Cybersecurity is one of AI's biggest risk domains—Attackers only need one exploit, but defenders must patch everything. Dawn Song reveals frontier AI can find vulnerabilities for just a few dollars and argues for a shift to formally verified, secure-by-design systems.👇

More recordings from the London Alignment Workshop are now available. New videos from Neel Nanda, Marius Hobbhahn, Robert Trager, Sören Mindermann, Ryan Lowe, @scasper.bsky.social, @conitzer.bsky.social, @zhijingjin.bsky.social + more. 👇

Without reliable deception detection, there's no clear path to high-confidence AI alignment. Black-box monitoring alone can't get us there. White-box methods that read model internals offer more promise. Our latest blog explains why. 👇

Yisen Wang showed that safety isn't erased, just masked. Removing reasoning neurons cut harmful rates 33%→5%, random removal did nothing. SafeReAct reactivates hidden safety using lightweight LoRA on harmful prompts only. 👇

Two new recordings from the London Alignment Workshop: Rohin Shah on why safety research fails to move decisions at frontier labs, and what to do about it. @ghadfield.bluesky.social on why AI governance can't verify the claims it's supposed to oversee, and how to fix it. Links in replies 👇

Single-agent red teaming keeps finding the same attacks. @natashajaques.bsky.social uses multi-agent self-play where attacker and defender co-evolve. Every exploit gets patched, forcing new discoveries. This results in 95% fewer harmful outputs with only 5% more refusals. 👇

The laws of physics don't care about you. That's what makes them safe. @yoshuabengio.bsky.social argues we can train AI the same way. In the "truthification pipeline" training data is categorized as either factual or a claim. This allows the AI to answer what it actually thinks it true. 👇

Interpretability produced insights but didn't necessarily impact AGI safety. Neel Nanda's pivot: study what works. Anthropic made progress on eval awareness with simple activation steering. His team now grounds work in testable proxy tasks, fails fast on dead ends. 👇

200+ researchers joined London Alignment Workshop Day 2 for talks on governance, scheming & multi-agent safety. Thanks to Allan Dafoe, Gillian Hadfield, Marius Hobbhahn, Joseph Bloom, Ryan Lowe, Stephen Casper, Sören Mindermann and all speakers! 👇

London Alignment Workshop Day 1 on interpretability, scalable oversight & EU AI policy. Rohin Shah, Neel Nanda, Zachary Kenton, Vincent Conitzer, Owain Evans, James Black, Christopher Summerfield, Matthieu Delescluse, Simon Möller, Victoria Krakovna and more. Ready for Day 2! 👇

"Move fast, break things" isn't appropriate when the stakes are this high. Our CEO @gleave.me told CNBC that coding agents are already replacing engineers. While agentic swarms are overhyped for now, we're building on an insecure substrate that attackers will exploit at scale. 👇

Even a 1% chance we all die is not something we can just take lightly. @yoshuabengio.bsky.social explains why he shifted from AI capabilities to safety research, his ChatGPT wakeup call, thinking about his children when evaluating AI risk, and the hopeful path forward. Watch the chat 👇

1/ Open-weight AI models often refuse harmful requests... until you “put a few words in their mouth.” We conducted the largest study of prefill attacks, and found that state-of-the-art models are consistently vulnerable, with attack success rates approaching 100%.

1/ Training data attribution (TDA) is broken: methods are slow and find syntactically similar data, not actual causes. Our solution Concept Influence: semantically meaningful results, better performance, 20x faster approximations. We attribute it to concepts, not examples. 🧵

Deception Workshop brought researchers together in SF to detection & mitigation of deceptive behavior in advanced AI systems. Led by Chris Cundy with talks from Neel Nanda, Joseph Bloom, Micah Carroll, Walter Laurito & Kieron Kretschmar on mech interp, scheming, CoT monitoring & lie detection.👇

Models now detect when they're being evaluated and game their responses. Marius Hobbhahn found awareness jumped from 2% to 20.6%. They actively grep for "grader.py" to reverse-engineer tests. Worse: removing awareness increases harmful behavior. This only gets worse with more capable models. 👇

Researchers are gathering today to tackle AI deception. The workshop builds on Chris Cundy's finding: high-quality lie detectors can cut deception ~50%, but weak ones backfire. Models can learn to evade rather than become honest.👇

1. Can you trust models trained directly against probes? We train an LLM against a deception probe and find four outcomes: honesty, blatant deception, obfuscated policy (fools the probe via text), or obfuscated activations (fools it via internal representations).

AI safety and inclusion are not side constraints. They are core to sustainable development.​ Join us at #IndiaAIImpactSummit2026 with Stuart Russell, Jaan Tallinn, Kalika Bali & leaders from UNDP, Bhashini, WadhwaniAI, EkStep+more. Feb 16 | 1:30 PM IST 👇

APE update: we retested recent frontier models on whether they still comply with requests to persuade on extreme harm (terrorism, sexual abuse). GPT-5.1 & Claude Opus 4.5 → near zero compliance. But Gemini 3 Pro complies 85% with no jailbreak needed. 🧵

Will you be in London on March 2? Join us for the Open Social: a casual evening of networking & conversation for anyone interested in AI safety. Held alongside our Alignment Workshop for global leaders from academia & industry. Mon March 2 | 7–9PM GMT | RSVP by 2/27 👇

Over the last two years, UK AI Security Instite has jailbroken every frontier model. Xander Davies presents on how jailbreaking has gotten more difficult, which forms of misuse are easier to pull off, and that the improvement has been driven by engineering, not model capabilities.👇

Attending the India AI Impact Summit? Join FAR.AI & Haqdarshak for a session on AI safety and sustainable development. We’re bridging the gap between technical risk and real-world impact in the Global South. Feb 16 | 1:30 PM IST | Bharat Mandapam, New Delhi 👇

AI governance increasingly relies on broken benchmarks. @ankareuel.bsky.social found many can't distinguish signal from noise, lack documentation, and have poor validity. GPQA claims 448 multiple choice questions measure graduate reasoning. It doesn't really. 👇

AI Safety Researchers in London 🇬🇧: Attend the London Alignment Workshop, March 2–3! Top ML researchers from industry, academia & government will discuss AI alignment, including model evaluations, interpretability, and robustness. 👇

"It's easier to verify a proof than to find it." Max Tegmark: "It's easier to verify a proof than to find it." Vericoding has AI generate formally verified code, achieving 82% success. Superintelligent AI may be easier to verify, thus more controllable. 👇

Open-weight model safety is AI safety in hard mode. Anyone can modify every parameter. @scasper.bsky.social: Open-weight models are only months behind closed models, which are reaching dangerous capability thresholds. 2026 will be critical.👇

100% of OpenAI PRs reviewed by Codex; >80% get positive engineer feedback. Twist: code reviewer & generator are same model, creating gaming risk. Maja Trębacz: oversight needs an ensemble of monitors as code volume grows exponentially and human attention doesn’t.👇

FAR.AI is hiring engineers and scientists! Join one of our teams: - Deception - stress-test and train against lie detectors - Integrity - red-team frontier models and write evals for new threats - Foundations - develop infrastructure for scalable ML workflows NEW 3-6mo fellowship Links👇

Our Q4 update is out: New work on AI persuasion, honesty & sandbagging, our European Commission CBRN risk assessment, highlights from the San Diego Alignment Workshop. Plus, find out about our upcoming events and open roles.👇

Our latest collaboration with CMU, Cornell, and others: AI is just as effective at spreading conspiracy beliefs as it is at debunking them. We found a fix that works, showing that we need to make deliberate design choices. Full thread below.

Join us at #AAAI2026 for our oral & poster on STACK: Adversarial Attacks on LLM Safeguard Pipelines on Jan 22 in Singapore. Layered defenses guard frontier LLMs against misuse, but we show they can be bypassed using a staged attack.👇

Red-blue team games for AI control: Asa Cooper Stickland pitted Claude 3.7 Sonnet monitors against Claude 4.1 Opus as the untrusted model. Blue team outpaced red team across three rounds, but Opus still won 6% of the time by gaslighting monitors. We’re nowhere near deployment-ready. 👇

Transformers force externalized reasoning; activations can only influence lower layers through visible tokens for subsequent positions. Tomek Korbak: This makes chain-of-thought monitorable, but optimization pressure and new architectures threaten this opportunity. 👇

In 2025, coding agents jumped from 14% to 74% accuracy while safety lagged behind. Universal jailbreaks achieved 100% success on new frontier models within weeks. @ARGleave on why we're only as safe as the least safe model, and what 2026 requires.👇

The AI industry runs on invisible dependencies. @cen_sarah’s team at Stanford is mapping out potential choke points: talent flows shaped by immigration policy, compute concentration, cascading failure risks. "One goes down, we might experience industry-wide harms." 👇

What happens if AI systems control military escalation between superpowers? Hamza Chaudhry warns that structural factors, not presidents, may be driving AI into nuclear command systems, possibly within 5 years. AI ≠ modernization 👇

Cybertruck attacker chose ChatGPT because of its simple text interface. Irene Solaiman argues this is why "available vs accessible" matters more than "open vs closed." Llama3 405B is open but compute-intensive; ChatGPT is closed but easy to use. available≠accessible 👇

We're honored that the Frontier Model Forum’s AI Safety Fund is supporting our project, "Quantifying the Safety-Adversary Gap in Large Language Models." We're one of 11 grantees selected from over 100 proposals in a $5M+ cohort tackling biosecurity, cybersecurity, and AI evaluation. 👇

4 recordings now live from the San Diego Alignment Workshop! Sam Bowman - Lessons from the First Misalignment Safety Case Maja Trębacz - Scalable Oversight: Verifying Code at Scale Neel Nanda - Our Pivot To Pragmatic Interpretability Anka Reuel - How do we know what AI can (and can't) do? 👇

Can AI 'sandbag' — deceptively underperform on evaluations? And can we detect them if they do? We investigated this in an auditing game with @AISecurityInst. In our app 👇, see if *you* can detect sandbagging by taking on the role of the blue team!

Mech Interp Workshop #NeurIPS2025 poster & spotlight presentation today! 📍 11:30am-12:30pm Sun, Dec 7 @ Upper Level Room 30A-E Path Channels & Plan Extension Kernels: A Mechanistic Description of Planning in a Sokoban RNN. by @taufeeque.bsky.social, Aaron Tucker, @gleave.me, Adrià Garriga-Alonso👇

Come check out our #NeurIPS2025 Lock-LLM Workshop poster: 📍 Sat, Dec 6 @ 12pm PST in Upper Level Room 1AB The Safety Gap Toolkit: Evaluating Hidden Dangers of Open-Source Models. Work by Ann-Kathrin Dombrowski, Dillon Bowen, @gleave.me, Chris Cundy bsky.app/profile/far....

Two new recordings from our AGI Journalism Workshop with @tarbellcenter: @gleave.me: AI systems can fake alignment during training. Scalable oversight & lie detectors can reduce this. @alexbores.nyc: NY's RAISE Act passed with bipartisan support despite lobbying. 👇

Join us at our #NeurIPS2025 main session presentation and poster! 📍 Wed, Dec 3 at 11am PST for Poster #509 in Exhibit Halls C, D, E Preference Learning with Lie Detectors can Induce Honesty or Evasion. Work by Chris Cundy and @gleave.me 👇

San Diego Alignment Workshop Day 2 on agentic AI safety, red teaming, privacy and security challenges. Thanks to @boknilev.bsky.social @atoosakz.bsky.social @scasper.bsky.social Neel Nanda, Dawn Song, Xander Davies and all speakers and attendees! 👇

FAR.AI is hiring a Head of Engineering (Research). Lead and scale our technical team as we work with frontier labs and governments to advance AI safety. If you want to drive research that shapes the trajectory of advanced AI systems, we want to meet you.👇