Excited to share a new paper that aims to narrow the conceptual gap between the idealized notion of Kolmogorov complexity and practical complexity measures for neural networks.

Excited to share 𝐈𝐧𝐟𝐀𝐥𝐢𝐠𝐧! Alignment optimization objective implicitly assumes 𝘴𝘢𝘮𝘱𝘭𝘪𝘯𝘨 from the resulting aligned model. But we are increasingly using different and sometimes sophisticated inference-time compute algorithms. How to resolve this discrepancy?🧵

I'll be at NeurIPS this week. Please reach out if you would like to chat!

New starter pack! go.bsky.app/GZ4hZzu

Two BioML starter packs now: Pack 1: go.bsky.app/2VWBcCd Pack 2: go.bsky.app/Bw84Hmc DM if you want to be included (or nominate people who should be!)

Wanted to share that Varun Godbole recently released a prompting playbook. The title says prompt tuning, but this is text prompts, not soft prompts. github.com/varungodbole...

New here? Interested in AI/ML? Check out these great starter packs! AI: go.bsky.app/SipA7it RL: go.bsky.app/3WPHcHg Women in AI: go.bsky.app/LaGDpqg NLP: go.bsky.app/SngwGeS AI and news: go.bsky.app/5sFqVNS You can also search all starter packs here: blueskydirectory.com/starter-pack...

Getting set up on Bluesky today!

I’m pretty excited about this one! ALTA is A Language for Transformer Analysis. Because ALTA programs can be compiled to transformer weights, it provides constructive proofs of transformer expressivity. It also offers new analytic tools for *learnability*. arxiv.org/abs/2410.18077