Attending the India AI Impact Summit? Join FAR.AI & Haqdarshak for a session on AI safety and sustainable development. We’re bridging the gap between technical risk and real-world impact in the Global South. Feb 16 | 1:30 PM IST | Bharat Mandapam, New Delhi 👇

AI governance increasingly relies on broken benchmarks. @ankareuel.bsky.social found many can't distinguish signal from noise, lack documentation, and have poor validity. GPQA claims 448 multiple choice questions measure graduate reasoning. It doesn't really. 👇

AI Safety Researchers in London 🇬🇧: Attend the London Alignment Workshop, March 2–3! Top ML researchers from industry, academia & government will discuss AI alignment, including model evaluations, interpretability, and robustness. 👇

"It's easier to verify a proof than to find it." Max Tegmark: "It's easier to verify a proof than to find it." Vericoding has AI generate formally verified code, achieving 82% success. Superintelligent AI may be easier to verify, thus more controllable. 👇

Open-weight model safety is AI safety in hard mode. Anyone can modify every parameter. @scasper.bsky.social: Open-weight models are only months behind closed models, which are reaching dangerous capability thresholds. 2026 will be critical.👇

100% of OpenAI PRs reviewed by Codex; >80% get positive engineer feedback. Twist: code reviewer & generator are same model, creating gaming risk. Maja Trębacz: oversight needs an ensemble of monitors as code volume grows exponentially and human attention doesn’t.👇

FAR.AI is hiring engineers and scientists! Join one of our teams: - Deception - stress-test and train against lie detectors - Integrity - red-team frontier models and write evals for new threats - Foundations - develop infrastructure for scalable ML workflows NEW 3-6mo fellowship Links👇

Our Q4 update is out: New work on AI persuasion, honesty & sandbagging, our European Commission CBRN risk assessment, highlights from the San Diego Alignment Workshop. Plus, find out about our upcoming events and open roles.👇

Our latest collaboration with CMU, Cornell, and others: AI is just as effective at spreading conspiracy beliefs as it is at debunking them. We found a fix that works, showing that we need to make deliberate design choices. Full thread below.

Join us at #AAAI2026 for our oral & poster on STACK: Adversarial Attacks on LLM Safeguard Pipelines on Jan 22 in Singapore. Layered defenses guard frontier LLMs against misuse, but we show they can be bypassed using a staged attack.👇

Red-blue team games for AI control: Asa Cooper Stickland pitted Claude 3.7 Sonnet monitors against Claude 4.1 Opus as the untrusted model. Blue team outpaced red team across three rounds, but Opus still won 6% of the time by gaslighting monitors. We’re nowhere near deployment-ready. 👇

Transformers force externalized reasoning; activations can only influence lower layers through visible tokens for subsequent positions. Tomek Korbak: This makes chain-of-thought monitorable, but optimization pressure and new architectures threaten this opportunity. 👇

In 2025, coding agents jumped from 14% to 74% accuracy while safety lagged behind. Universal jailbreaks achieved 100% success on new frontier models within weeks. @ARGleave on why we're only as safe as the least safe model, and what 2026 requires.👇

The AI industry runs on invisible dependencies. @cen_sarah’s team at Stanford is mapping out potential choke points: talent flows shaped by immigration policy, compute concentration, cascading failure risks. "One goes down, we might experience industry-wide harms." 👇

What happens if AI systems control military escalation between superpowers? Hamza Chaudhry warns that structural factors, not presidents, may be driving AI into nuclear command systems, possibly within 5 years. AI ≠ modernization 👇

Cybertruck attacker chose ChatGPT because of its simple text interface. Irene Solaiman argues this is why "available vs accessible" matters more than "open vs closed." Llama3 405B is open but compute-intensive; ChatGPT is closed but easy to use. available≠accessible 👇

We're honored that the Frontier Model Forum’s AI Safety Fund is supporting our project, "Quantifying the Safety-Adversary Gap in Large Language Models." We're one of 11 grantees selected from over 100 proposals in a $5M+ cohort tackling biosecurity, cybersecurity, and AI evaluation. 👇

4 recordings now live from the San Diego Alignment Workshop! Sam Bowman - Lessons from the First Misalignment Safety Case Maja Trębacz - Scalable Oversight: Verifying Code at Scale Neel Nanda - Our Pivot To Pragmatic Interpretability Anka Reuel - How do we know what AI can (and can't) do? 👇

Can AI 'sandbag' — deceptively underperform on evaluations? And can we detect them if they do? We investigated this in an auditing game with @AISecurityInst. In our app 👇, see if *you* can detect sandbagging by taking on the role of the blue team!

Mech Interp Workshop #NeurIPS2025 poster & spotlight presentation today! 📍 11:30am-12:30pm Sun, Dec 7 @ Upper Level Room 30A-E Path Channels & Plan Extension Kernels: A Mechanistic Description of Planning in a Sokoban RNN. by @taufeeque.bsky.social, Aaron Tucker, @gleave.me, Adrià Garriga-Alonso👇

Come check out our #NeurIPS2025 Lock-LLM Workshop poster: 📍 Sat, Dec 6 @ 12pm PST in Upper Level Room 1AB The Safety Gap Toolkit: Evaluating Hidden Dangers of Open-Source Models. Work by Ann-Kathrin Dombrowski, Dillon Bowen, @gleave.me, Chris Cundy bsky.app/profile/far....

Two new recordings from our AGI Journalism Workshop with @tarbellcenter: @gleave.me: AI systems can fake alignment during training. Scalable oversight & lie detectors can reduce this. @alexbores.nyc: NY's RAISE Act passed with bipartisan support despite lobbying. 👇

Join us at our #NeurIPS2025 main session presentation and poster! 📍 Wed, Dec 3 at 11am PST for Poster #509 in Exhibit Halls C, D, E Preference Learning with Lie Detectors can Induce Honesty or Evasion. Work by Chris Cundy and @gleave.me 👇

San Diego Alignment Workshop Day 2 on agentic AI safety, red teaming, privacy and security challenges. Thanks to @boknilev.bsky.social @atoosakz.bsky.social @scasper.bsky.social Neel Nanda, Dawn Song, Xander Davies and all speakers and attendees! 👇

FAR.AI is hiring a Head of Engineering (Research). Lead and scale our technical team as we work with frontier labs and governments to advance AI safety. If you want to drive research that shapes the trajectory of advanced AI systems, we want to meet you.👇

Day 1 of the San Diego Alignment Workshop on frontier alignment, evals, control and mech interp. @yoshuabengio.bsky.social @gleave.me @ankareuel.bsky.social Sam Bowman, Tomek Korbak, Max Tegmark, Daniel Kang, Adam Kalai, Chirag Agarwal, and more. Day 2 tomorrow! 👇

Agentic AI systems can plan, take actions, and interact with external tools or other agents semi-autonomously. New paper from CSA Singapore & FAR.AI highlights why conventional cybersecurity controls aren’t enough and maps agentic security frameworks & some key open problems. 👇

At our Journalism Workshop, NY Assemblymember @alexbores.nyc spoke on the RAISE Act and debate over state AI safety laws. These discussions support evidence-based policy for advanced AI systems. Safety plans and incident reporting strengthen trust and responsible innovation. 👇

It's a wrap on the AGI Journalism Workshop in D.C., co-hosted with the Tarbell Center for AI Journalism. ▸ AGI timelines, jobs, misalignment, U.S.–China policy & regulation ▸ @hlntnr.bsky.social, @akorinek.bsky.social, @imarinescu.bsky.social, @gleave.me, @alexbores.nyc, @deanwb.bsky.social + more

Frontier AI models with openly available weights are steadily becoming more powerful and widely adopted. They enable open research, but also create new risks. New paper outlines 16 open technical challenges for making open-weight AI models safer. 👇

Can social trust survive in the age of AI when healthcare regulators still often verify systems with mere screenshots? Ex-FDA Tina Morrison demonstrated EQTYLab embedding verifiable compute in next-gen Intel/NVIDIA chips: cryptographic proof without data access & 10% overhead. 👇

At #NeurIPS2025? Join us for the San Diego Alignment Workshop: Open Social, an evening of connection & conversation hosted by FAR.AI. 📍 Omni San Diego Hotel ⏰ Mon Dec 1 | 7–9PM PST RSVP by Nov 30 👇

This quarter, we red-teamed GPT-5, disclosed critical persuasion vulnerabilities to frontier labs (resulting in patches!), and co-organized AI Safety Connect at UNGA. Join us Dec 1-2 for San Diego Alignment Workshop. Plus, we're expanding 2x & hiring! 👇

AI brings both promise and peril to defense. Steve Kelly addresses 3 questions: What's its military value? Does it stabilize or destabilize? Will AI become the threat? His concerns span cognitive decline from over-reliance to unexpected emergent behaviors in multi-agent systems. 👇

Why might malicious actors choose less lethal but easier-to-hide weapons? Olivia Shoemaker argues current AI evaluations focus on scientific capabilities, often missing operational factors that determine real-world misuse patterns like evading detection and acquiring resources.👇

"What does democracy mean without meaningful work?" Brad Carson presents 14 unsettled AI policy questions including: AI needs 75 reactors' worth of power, Ukraine war shows incremental not revolutionary change, and broken predictive AI matters more than generative AI. 👇

AI experts have completely opposite views on the technology's future. @hlntnr.bsky.social on the open debates: Will scaling hit a wall? Can AI improve itself? “If we can't agree what's happening with AI, how can we agree what to do about it?” 👇

AI labs disclose 89% of capabilities but only 15% of impacts, an information gap for policymakers. Using his taxonomy of technical AI governance, Ben Bucknall shows why closing this gap requires stronger evaluation, independent oversight, and better incident tracking. 👇

AI agents can find and exploit real-world cybersecurity vulnerabilities today. Daniel Kang saw this major threat vector when ChatGPT launched, while others didn't. His research shows that more capable models are more proficient hackers. The threat is real and getting worse.👇

Join FAR.AI! Seeking Senior Programs & Strategy Manager to shape flagship AI safety events. Design conference agendas, curate speakers, manage stakeholders. Remote/Berkeley, $115-180k+. Technical grounding + stakeholder mgmt req'd. 👇

Models spontaneously learned to cheat, modifying tests instead of fixing code. Mary Phuong: With autonomy doubling every 7 months, they'll work 32 hours solo by 2028. We need AI Control as backup if alignment fails, using monitoring, escalation, security & red-teaming. 👇

We all agree AI audits are needed, but we can't agree what that means. @mbogen.bsky.social says policymakers can make sense out of this chaotic landscape if they define what they're trying to accomplish. The challenge isn't just mitigating known risks but identifying ones still emerging.👇

Having better security technology could make AI systems LESS safe. Robert Trager: Better security tech shifts the entire performance-security frontier outward, and actors may maintain equivalent security and performance. We need verification to avoid this.👇

Your 'secure' AI can be stolen using a laser. Physical attacks can extract user data through faults and pull model weights via side-channels, even with full encryption. Fatemeh Ganji presents a defense: multiparty computation from classical cryptography.👇

Did your paper get into #NeurIPS? 🎉 If so, consider joining us a few days early on December 1–2!

"AI that understands biology well enough to cure diseases can design extremely potent bioweapons." @alexbores.nyc, NY Assembly's 1st Democrat with a CS degree, who worked in AI, says state reps answer their own phones. Use that power to change the course of AI safety.👇

Policymakers have maybe 1 minute to read about your carefully crafted AI evals. Kevin Wei (RAND): Design & disseminate with policymakers in mind. Tie capabilities to policy levers like export controls. Scale from simple tests to real-world trials.👇

Heading to #NeurIPS2025? Apply for the San Diego Alignment Workshop, Dec 1-2. Top ML researchers from industry, academia & government discussing AI alignment, inc. model evaluations, interpretability, robustness, governance. $250-$1,300 tiered pricing. Financial aid available. 👇

How do we verify what AI companies are doing? Right now we just trust them. Lennart Heim: Trusting the math is sometimes better than trusting people, but “a good AI system” isn’t a technical property. We need engineers to verify AI policy goals. 👇

AI inference costs plummet 9-900x/year (o3, DeepSeek R1). @bencottier.bsky.social warns that evaluations are expensive now, but we need them to understand frontier AI capabilities before they're cheap & widespread.👇