Everyone’s favorite feed is running on one person’s gaming system. I love how hackable this site is, it makes it much more fun.

If you’re working on a non-fiction research/writing project that isn’t journalism and you don’t have an academic affiliation, how do you find other people who are doing the same thing? Ideally locally (I’m in NY).

local first vs atproto!! what should the source of truth for group data be?

I am late to the game but I finally read the NeurIPS 2025 best paper on gating in LLMs, it is great. Qiu et al. Alibaba, U Edinburg, Stanford, MIT, Tsinghua U arxiv.org/abs/2505.06708 1/3

Olmo 3.1 is here. We extended our strongest RL run and scaled our instruct recipe to 32B—releasing Olmo 3.1 Think 32B & Olmo 3.1 Instruct 32B, our most capable models yet. 🧵

Post on Interconnects: www.interconnects.ai/p/building-o... Slides: docs.google.com/presentation... YouTube: youtu.be/uaZ3yRdYg8A

i think i can officially say i preferred my arch linux desktop over macOS the best thing about macOS is the flow between computer, phone, airpods everything else feels like 10% off the mark and all these paper cuts don't feel good

Built a little AT Protocol playground - a single HTML file that lets you watch the firehose, create records, and browse any repo with a dynamic form UI. Changes sync directly back to your PDS. #atproto at.selem.im

A couple years (!) in the making: we’re releasing a new corpus of embodied, collaborative problem solving dialogues. We paid 36 people to play Portal 2’s co-op mode and collected their speech + game recordings. Paper: arxiv.org/abs/2512.03381 Website: berkeley-nlp.github.io/portal-dialo... 1/n

Makes me wonder how viable a presentation app that uses SVGs as its native format would be. LLMs tend to do fairly well with vector formats and it would solve the mutability problem here.

I've been having a bunch of fan hacking on my Bluesky thread viewing HTML+JS app using Claude Code - here's a video demo of the most recent version, you can try it out here tools.simonwillison.net/bluesky-thre...

⚠️ Update on Deep Research Tulu (DR Tulu), our post-training recipe for deep research agents: we’re releasing an upgraded version of our example agent, DR Tulu-8B (RL), that matches or beats systems like Gemini 3 Pro & Tongyi DeepResearch-30B-A3B on core benchmarks. 🧵

Test-time reasoning guidance: up to 66.7% improvement 💡 We scaffold cognitive structures from successful traces to guide reasoning. Major gains on ill-structured problems🌟 Models possess latent capabilities—they just don't deploy them adaptively without explicit guidance.

We analyzed 1,598 LLM reasoning papers: Research concentrates on easily quantifiable behaviors—sequential organization (55%), decomposition (60%) Neglects meta-cognitive controls (8-16%) and alternative representations (10-27%) that correlate with success⚠️

Our taxonomy bridges cognitive science → LLM eval: 28 elements across 4 dimensions—reasoning invariants (compositionality, logical coherence), meta-cognitive controls (self-awareness), representations (hierarchical, causal), and operations (backtracking, verification)

Goal-Conditioned Data Augmentation for Offline Reinforcement Learning Xingshuai Huang, Di Wu, Benoit Boulet Action editor: Baoxiang Wang https://openreview.net/forum?id=8K16dplpE0 #reinforcement #conditioning #learns

🌊 Global Mangrove Watch is using OlmoEarth to refresh mangrove map baselines faster, with higher accuracy & less manual annotation—allowing orgs + governments to respond to threats more quickly. Learn more → buff.ly/6xLHLk6

ml halloween costume concept

Yes!! A POMDP world model benchmark with controlled test environments. So excited to play with this

Really proud of this project led by @kylecranmer.bsky.social and created alongside these awesome collaborators and friends. I believe this is important work that will help researchers make grounded decisions when building multimodal models with many diverse inputs. Add it to your paper pile!

Cornell (NYC and Ithaca) is recruiting AI postdocs, apply by Nov 20, 2025! If you're interested in working with me on technical approaches to responsible AI (e.g., personalization, fairness), please email me. academicjobsonline.org/ajo/jobs/30971

Here is the recipe from the latest Thinking Machines blogpost about late post-training: - generate student rollouts - query teacher distribution forced on student history - update using the reverse KL divergence at each step thinkingmachines.ai/blog/on-poli...

Did an intro to tokenization lecture today and worked in this thread.

The first fantastic paper on scaling RL with LLMs just dropped. I strongly recommend taking a look and will be sharing more thoughts on the blog soon. The Art of Scaling Reinforcement Learning Compute for LLMs Khatri & Madaan et al. buff.ly/olKwF3X

NVIDIA sent me preview hardware of their new DGX Spark 128GB ARM64 4TB "AI supercomputer" - it's a very neat little device, here are my notes so far simonwillison.net/2025/Oct/14/...

Multi-Head Latent Attention 🔗 github.com/rasbt/LLMs-f...

⚠️ You have marked yourself as an untrusted node in the epistemic network

improving pretrained LLMs by searching over iid-noised params, using a reward score (aka fitness criterion) for weight-merging

We are excited to announce 4 outstanding papers 🏆🏆🏆🏆 --> 🧵

LLMs are currently this one big parameter block that stores all sort of facts. In our new preprint, we add context-specific memory parameters to the model, and pretrain the model along with a big bank of memories. 📑 arxiv.org/abs/2510.02375 [1/10]🧵

accepted papers, COLM 2025 colmweb.org/AcceptedPape...

Paper: arxiv.org/pdf/2509.20328

Spaced Scheduling for Large Language Model Training Amine El hattami, Nicolas Chapados, Christopher Pal Action editor: Colin Raffel https://openreview.net/forum?id=p0KTYl2B9T #scheduling #scheduled #training

really neat clear explainer for the new on “centralizing flows” to theoretically model learning dynamics

Scaling laws don’t just show up in test error — they leave fingerprints in the weight spectrum. In the feature learning regime, we map this connection: phase diagrams of scaling exponents <-> spectral signatures of trained weights. The paper is: arxiv.org/abs/2509.24882

latent space opera

New technical post from Thinky on optimizers but this is the main catch: conditional learning rate per layers. thinkingmachines.ai/blog/modular...

Isaac-01 multimodal model from Perceptron AI - pdf whitepaper github.com/perceptron-a...

New (March) Schmidhuber I missed where they use a carefully engineered layer to track the information gained by each (prediction) token for solving problems that require computation. Hidden state is predictive of (a? not necessarily minimal?) description length.

the Perceptron folks are sharing design specs of their approach to serialize multimodal data as interleaved events www.perceptron.inc/blog/tensors...

Google's Mixboard 💡🧑‍🎨 an experimental, AI-powered concepting board. Designed to help you explore, visualize, and refine your ideas and powered by our latest image generation model Only available in U.S. blog.google/technology/g...

We've hired some *fantastic* researchers but our startup is still looking for 2-3 more people with skills in ML/RL/LLMs. If you'd like to work on some transformative applied problems, hit me up. We'll be launching publicly soon too...

Surprise! A second leaflet on private data in AT, this time exploring some schemes that might be used to implement shared-private data.

Qwen drops Image Edit: apache 2 that feels on par with Nano Banana qwen.ai/blog?id=7a90... Qwen3-Omni: unified image, text, audio and video, like GPT-4o huggingface.co/Qwen/Qwen3-O... Qwen3-TTS: multi-timbre, multi-lingual TTS qwen.ai/blog?id=b426...

I made an agent that unsubscribes you from spam. It controls a web browser to navigate an unsubscribe page. The agent runs JavaScript to perform actions on the page, and gets to see a screenshot after each action it takes. Blog post: blog.aqnichol.com/2025/09/20/u...

Policy churn: maybe epsilon greedy doesn’t matter that much because the Q value argmax action changes constantly arxiv.org/abs/2206.00730

Today my azure A100 quota came through as a little treat. It took about two weeks to get the quota approved…which isn’t bad, I’m not complaining. It’s so great to be installing nvidia drivers again

I've been nerdsniped by the idea of Semantic IDs. Here's the result of my training runs: • RQ-VAE to compress item embeddings into tokens • SASRec to predict the next item (i.e., 4-tokens) exactly • Qwen3-8B that can return recs and natural language! eugeneyan.com/writing/sema...

On the tradeoffs of state space models and transformers (Albert Gu July 2025, Goomba Lab blog) goombalab.github.io/blog/2025/tr...

🎥 Videos of our invited talks and the panel discussion are now also available on YouTube: www.youtube.com/@tokenizatio... ▶️