Headed to @cvprconference.bsky.social in Nashville! I'll be presenting our work on Multimodal Reward-guided Decoding. Let's connect if you're around!

TFW you find a memory leak in your code two days before the rebuttal's deadline

Heading to Singapore for the next 1.5 weeks for @iclr-conf.bsky.social. If you're around and want to meet up, hit me up!

"Tokenize Everything!" Luke Zettlemoyer of @uofwa.bsky.social on using GPT-like autoregressive techniques for training multimodal models (text, images, audio etc.) at the Simons Institute workshop on The Future of Language Models and Transformers simons.berkeley.edu/workshops/fu...

I quite like this analogy by Oriol Vinyals: * LLM ~= core electric brain * Agent ~= LLM with a digital body youtu.be/78mEYaztGaw

Curious about how to effectively steer the behavior of multimodal LLMs during inference to improve their visual grounding? Join me today at 4:30pm at the AFM workshop at @NeurIPSConf, where I'll be presenting a poster on my work. Come by to learn more! openreview.net/forum?id=VWJ...

Tomorrow at 3:15pm I'll be presenting my work at @mila-quebec.bsky.social's booth (#104) at @neuripsconf.bsky.social. Come to learn more about controlling multimodal LLMs via reward-guided decoding! 🔗 openreview.net/forum?id=VWJ...

All this being said, Meta/FAIR remains the only place where you can do open AI research with a group of stellar colleagues ten times larger than any university + big-tech computational capabilities level.