Our new paper in #PNAS (bit.ly/4fcWfma) presents a surprising finding—when words change meaning, older speakers rapidly adopt the new usage; inter-generational differences are often minor. w/ Michelle Yang, ‪@sivareddyg.bsky.social‬ , @msonderegger.bsky.social‬ and @dallascard.bsky.social‬👇(1/12)

Age doesn't matter to pick up new word usages. The pronunciation may sound odd across generations but not the semantics 👴👵👨👩

🗓️ Save the date! It's official: The VLMs4All Workshop at #CVPR2025 will be held on June 12th! Get ready for a full day of speakers, posters, and a panel discussion on making VLMs more geo-diverse and culturally aware 🌐 Check out the schedule below!

Incredibly proud of my students @adadtur.bsky.social and Gaurav Kamath for winning a SAC award at #NAACL2025 for their work on assessing how LLMs model constituent shifts.

Great work from labmates on LLMs vs humans regarding linguistic preferences: You know when a sentence kind of feels off e.g. "I met at the park the man". So in what ways do LLMs follow these human intuitions?

List of #SafetyGuaranteedLLMs talks on Monday Apr 14 2025 PDT. Speakers @rogergrosse.bsky.social Boaz Barak, Ethan Perez, Georgios Piliouras

The most exciting event on LLM safety is happening this week at @simonsinstitute.bsky.social with many excellent speakers. Organized by @yoshuabengio.bsky.social et al. Join us in person or virtual. In collaboration with @ivado.bsky.social. More details here: simons.berkeley.edu/workshops/sa...

Though in-person registration is now full, you can still register to view the private livestream for next week's workshop on Safety-Guaranteed LLMs, co-organized with @ivado.bsky.social. We'll be posting live here as well. simons.berkeley.edu/workshops/sa...

Never been part of a project like this before - it was a very rewarding+unique experience! Everyone in the lab contributed different chapters and it was much more exploratory than your average phd project. My chapter studied R1's reasoning on "image generation/editing" (via ASCII) 🧵👇 1/N

I will be giving a talk about this work @SimonsInstitute tomorrow (Apr 2nd 3PM PT). Join us, both in-person or virtually. simons.berkeley.edu/workshops/fu...

Introducing the DeepSeek-R1 Thoughtology -- the most comprehensive study of R1 reasoning chains/thoughts ✨. Probably everything you need to know about R1 thoughts. If we missed something, please let us know.

A bit of a mess around the conflict of COLM with the ARR (and to lesser degree ICML) reviews release. We feel this is creating a lot of pressure and uncertainty. So, we are pushing our deadlines: Abstracts due March 22 AoE (+48hr) Full papers due March 28 AoE (+24hr) Plz RT 🙏

As someone who has tried to make even basic image editing work in my research (e.g. "move cup to left of table"): Gemini's new editing capabilities are seriously impressive! Playing around with it is quite fun... Edit 1: "edit the image to contain 3 more people"

Why do LLMs have a hard time aligning, while humans are better at it? 🌟The answer lies in the lack of a societal alignment framework for LLMs 🌍. Incredible effort by @karstanczak.bsky.social in pulling views from multiple disciplines and experts in these fields. arxiv.org/abs/2503.00069

How to Get Your LLM to Generate Challenging Problems for Evaluation? 🤔 Check out our CHASE recipe. A highly relevant problem given that most human-curated datasets are crushed within days.

Finally it's handy that all my twitter posts got migrated here to bsky: I'll be presenting AURORA at @neuripsconf.bsky.social on Wednesday! Come by to discuss text-guided editing (and why imo it is more interesting than image generation), world modeling, evals and vision-and-language reasoning

Congratulations @andreasmadsen.bsky.social on successfully defending your PhD ⚔️ 🎉🎉 Grateful to you for stretching my interests into interpretability and engaging me with exciting deas. Good luck with your mission on building faithfully interpretable models.

“Turn” a decoder into an encoder with LLM2Vec (github.com/McGill-NLP/l...). Seen at COLM 2024 :) If you want the naive, training-free / model-agnostic approach: their related work section says it is most common to using the final token’s last hidden state.

Stages of #ICLR reviewing: Stage 1: 😍 I hope I learn something new Stage 2: 🤗 I hope I am constructive enough while being critical. Submits review Stage 3: 🤯 Receives 5 page response + revision with many new pages Stage 4: 😱 Crap, how do I get out of this? Stage 5: 😵‍💫 What year is it?

I wrote some thoughts on how to build good LM benchmarks: ofir.io/How-to-Build...

@sivareddyg.bsky.social Which platforms? Maybe consider @buffer.com

It's beautiful to start from scratch sometimes 😇

Creating a 🦋 starter pack for people working in IR/RAG: go.bsky.app/88ULgwY I can’t seem to find everyone though, help definitely appreciated to fill this out (DM or comment)!

I find it unintuitive that user handles have to be appended with bsky.social? Can we get rid of it?

This space has good vibes and clear skies 🌞. Any tips on how to crosspost across platforms for the time being without manually copy pasting?