I spent some time trying to distill all the complex factors impacting open models -- economics, capabilities, distribution, policy, etc. -- into a clear list of beliefs. Here they are in full. www.interconnects.ai/p/my-bets-on...

DeepMind's RL team is hiring a research scientist: if you're passionate about RL, come work with us! And if you know people who might be interested, please share: job-boards.greenhouse.io/deepmind/job...

Newish work (arXived in December): Prompts can be ambig., but handling ambiguity is context/user dependent. Sometimes the right thing is to ask a clarifying question, sometimes to give multi. answers, and sometimes to just guess. Can we train steerable models that change their strategy per context?

Are AI models effective collaborators, or mere assistants awaiting your next command? (Preprint: arxiv.org/abs/2602.24188) To find out, we make AI collaborate with itself, in private information games: tasks that require sharing private information, like this chess board ordering task.

This looks like it’ll be a fantastic intro to transformers ⚡️

[1/n] Just wrapped up 7 months interning with @pcastr.bsky.social at Google DeepMind and I'm so excited to share our work: arxiv.org/abs/2602.10324. TLDR: We used LLM-powered program synthesis to automatically model and discover differences between human and LLM strategic behavior

🚨 🔬 PhD positions at Google DeepMind in France 🇫🇷 We are advertising Master Level Intern positions at Google DeepMind within our Frontier AI Unit. These could lead to co-advised PhD positions with Google DeepMind and French academic institutions. job-boards.greenhouse.io/deepmind/job...

meanwhile, in the pnw www.seattletimes.com/seattle-news...

Hello! 👋 Are you interested in AI for board games using language models? Want to do some hobby tinkering with fine-tuning or RL? We've released an easy-to-follow example colab that fine-tunes Gemma models via Kauldron to mimic an MCTS player. Details here: github.com/google-deepm... ♟️🎲♦️♠️♥️♣️✨🎉

Day 1 of #BooksAreMyJam! Blueberry Maple jam, with Linguaphile: A life of language love by Julie Sedivy. A classic Canadian flavour duo + this book about @juliesedivy.bsky.social's relationship with language through her childhood in Montreal, later research as a linguist, and more

this is the theme — you can’t have AGI without existing in and learning from the real world

No better time to start learning about that #AI thing everyone's talking about... 📢 I'm recruiting PhD students in Computer Science or Information Science @cornellbowers.bsky.social! If you're interested, apply to either department (yes, either program!) and list me as a potential advisor!

knowing how to tie your shoes or order a drink in a crowded bar: not agi naming the big five personality traits: definitely agi

nice summary of everybody’s new fave

Nicholas Carlini asking the right questions at #COLM2025

Here’s a #COLM2025 feed! Pin it 📌 to follow along with the conference this week!

AI always calling your ideas “fantastic” can feel inauthentic, but what are sycophancy’s deeper harms? We find that in the common use case of seeking AI advice on interpersonal situations—specifically conflicts—sycophancy makes people feel more right & less willing to apologize.

Excited to share a new paper that aims to narrow the conceptual gap between the idealized notion of Kolmogorov complexity and practical complexity measures for neural networks.

Cannot stress enough how good it is that you can come across a post about gorgeous little Yiddish book sitting in someone’s family collection, and within a few seconds you can find the full scanned version of the book available for free through the Yiddish Book Center’s website

found some books at my parents’ house

Baristas still safe from robotic automation, and not just because robots don’t know what coffee tastes like. prompt: “I’m trying to dial in this v60 of huatusco with my vario. temp / grind recommendations?”

I’d guess that the majority position of syntacticians about LLMs (and other NLP beforehand) is roughly what Chomsky says: language tech can’t possibly teach us anything about the human language capability, so whether the LLM writes well doesn’t matter at all.

boston champaign pittsburgh atlanta, and, uh, let’s count seattle glad i did it, hope i don’t have to do it again

🤖 ICYMI: Yesterday, @hf.co and OpenAI partnered to bring open source GPT to the public. This is a Big Deal in "AI world". Allow me to explain why. 🧵 huggingface.co/openai/gpt-o...

roman burrito thread

this is very cool and i’m looking forward to reading the paper, but a basic question about this data: isn’t it likely that a congressional rep’s speeches are written by a shifting cast of speechwriters over the course of their career? wouldn’t that explain adoption of new usages?

Our new paper in #PNAS (bit.ly/4fcWfma) presents a surprising finding—when words change meaning, older speakers rapidly adopt the new usage; inter-generational differences are often minor. w/ Michelle Yang, ‪@sivareddyg.bsky.social‬ , @msonderegger.bsky.social‬ and @dallascard.bsky.social‬👇(1/12)

There's a lot to like in this position paper - and not just the "whiff of Frankenstein" quote. www.arxiv.org/abs/2507.06268

What are your favorite recent papers on using LMs for annotation (especially in a loop with human annotators), synthetic data for task-specific prediction, active learning, and similar? Looking for practical methods for settings where human annotations are costly. A few examples in thread ↴

[Thu Jul 17] w/ Ananth Balashankar & @jacobeisenstein.bsky.social, we present a reinforcement learning framework in view of test-time scaling. We show how to optimally calibrate & transform rewards to obtain optimal performance with a given test-time algorithm.

[Wed Jul 16] w/ @jacobeisenstein.bsky.social & Alekh Agarwal, we present a theoretical characterization of best-of-N (a simple yet effective method for test-time scaling & alignment). Our results justify the widespread use of BoN as a strong baseline in this space.

Cheap but noisy? Or accurate but expensive? How to split a limited annotation budget between different types of judges?👩‍⚖️🤖🦧 www.arxiv.org/abs/2506.07949

Everyone should check out People Time, the recording of his dates with Kenny Barron in Copenhagen three months before his death. Getz knew he was dying, and produced some of the most moving music of his career. www.youtube.com/watch?v=c3jd...

Great topic! looking forward to this

most relatable parenting thread

A new blog post with intuitions behind continuous-time Markov chains, a building block of diffusion language models, like @inceptionlabs.bsky.social's Mercury and Gemini Diffusion. This post touches on different ways of looking at Markov chains, connections to point processes, and more.

People keep plugging AI "Co-Scientists," so what happens when you ask them to do an important task like finding errors in papers? We built SPOT, a dataset of STEM manuscripts across 10 fields annotated with real errors to find out. (tl;dr not even close to usable) #NLProc arxiv.org/abs/2505.11855

‘intermediate tokens-often anthropomorphized as "thoughts" or reasoning traces’ 🌶️ but true! really glad to see work approaching inference scaling more skeptically and objectively

Dear ChatGPT, Am I the Asshole? While Reddit users might say yes, your favorite LLM probably won’t. We present Social Sycophancy: a new way to understand and measure sycophancy as how LLMs overly preserve users' self-image.

Google Deepmind is hiring a research scientist in Seattle to work on foundational research in language! job-boards.greenhouse.io/deepmind/job...

#ICML2025 Is standard RLHF optimal in view of test-time scaling? Unsurprisingly no. We show a simple change to standard RLHF framework that involves 𝐫𝐞𝐰𝐚𝐫𝐝 𝐜𝐚𝐥𝐢𝐛𝐫𝐚𝐭𝐢𝐨𝐧 and 𝐫𝐞𝐰𝐚𝐫𝐝 𝐭𝐫𝐚𝐧𝐬𝐟𝐨𝐫𝐦𝐚𝐭𝐢𝐨𝐧 (suited to test-time procedure) is optimal!

uh oh! uh oh!

Gemma 3 explained: Longer context, image support, and a new 1B model. → goo.gle/4lV8iaw Other key enhancements: 🔸 Best model that fits in a single consumer GPU or TPU host 🔸 KV-cache memory reduction with 5-to-1 interleaved attention 🔸 And more! Read the blog for the full details on Gemma 3.

lol www.quantamagazine.org/when-chatgpt...

on my way back to NYC, i met wise Leon Bottou in the airport. we talked. then i told him "you should tweet that!" and, he delivered much more than a tweet: a blog post with thoughts and insights on AI research only he can deliver this clearly and succinctly. leon.bottou.org/news/two_les...

Confabulation and overconfidence are still problems for LLMs (among others) but it is just not true that these models are somehow technically constrained to make stuff up rather than abstaining from answering

Modern LLMs "speak" hundreds of languages... but do they really? Multilinguality claims are often based on downstream tasks like QA & MT, while *formal* linguistic competence remains hard to gauge in lots of languages Meet MultiBLiMP! (joint work w/ @jumelet.bsky.social & @weissweiler.bsky.social)

ok so!!! something I found really interesting after talking to Korean protesters was... well, it was actually me realizing something about protest in the US: protest is trapped in an unwinnable spiral about "peaceful" versus "violent" protest, and even people who know it's dumb can't break free

I'm going to slowly repost my math notes from the other site🐦 here🦋; it's the only thing I posted over there that I think may have some long-term value & worth not deleting. These started out as notes for myself, but people seem to appreciate them. 😅 I'll keep track of all of them in this thread.