Honored and excited to share that I am the winner of Nomis & Science Young Explorer Award!! Also thrilled to share that my article describing my research is out now in @science.org today! The normalization of (almost) everything www.science.org/doi/10.1126/... 1/

Now that the ICLR deadline is behind us, happy to share that From Language to Cognition has been accepted as an Oral at #EMNLP2025! 🎉 Looking forward to seeing many of you in Suzhou 🇨🇳

For folks considering grad school in ML, my advice is to explore programs that mix ML with a domain interest. ML programs are wildly oversubscribed while a lot of the fun right now is in figuring out what you can do with it

Keynote spotlight #3: COLM's second day will open with some *real* intelligence 🧠🧠🧠 with Tom Griffiths from Princeton

I finally got around to making a tool to compare completions from SFT vs. RLHF trained models. This is a mini site for the RLHF book that I've wanted for a while. buff.ly/lqDL5wa It's always been hard to say what RLHF does to a model within a more complex post-training pipeline.

Keynote spotlight #1: COLM will open on Oct 7 with a keynote by @lukezettlemoyer.bsky.social about mixed-modals models 🌈

It is again the time of year when I beg @aclmeeting.bsky.social execs to rethink the current streaming platform system. For my #EMNLP2025 submissions, I am *required* to upload 2 video recordings + 2 posters + 2 slide decks. Why force both posters and talks for all? Nonsense.

New paper! We find that the more prompts "look like" common benchmark tasks, the more model behavior changes. Even when we encourage the model to explicitly infer gender, the instruction itself causes the opposite, namely boosting gender-neutral language. Check out Bufan's thread and our paper!

🚨 New #EMNLP2025 paper! Do LLMs exhibit distinct behavior when the prompt looks similar to common evaluation prompts? 👀 We show that prompts that signal bias evaluation can flip the measured bias. See below ⬇️

We’re hiring @ucdavis.bsky.social Comm! TT Asst Prof in Mediated Interpersonal Communication. Our dept blends behavioral, biological & computational strengths at one of the most interdisciplinary campuses anywhere. Apps due Oct 15. Glad to chat recruit.ucdavis.edu/JPF07289

My lab at UCLA is hiring 1-2 PhD students this cycle! Join us to work at the intersection of cognitive science and AI applied to pressing societal challenges like climate change. More info about me: rachit-dubey.github.io My lab: ucla-cocopol.github.io Please help repost/spread the word!

How can an imitative model like an LLM outperform the experts it is trained on? Our new COLM paper outlines three types of transcendence and shows that each one relies on a different aspect of data diversity. arxiv.org/abs/2508.17669

The 2025-2026 #academic job market season is upon us. Here are some resources and #job postings for #faculty and #postdoc positions for those in Information/Computer/Social Sciences, and related fields. Will update the list as more #jobs are posted. 🧵(0/n) #AcademicChatter

New paper! We explore a radical paradigm for AI evals: assessing LLMs on *unsolved* questions. Instead of artificially difficult exams where progress ≠ value, we assess LLMs on organic, unsolved problems via reference-free LLM validation & community verification. LLMs solved ~10/500 so far:

Preprint announcement! 🎉 I've written a short position paper with Cindy Xiong Bearfield (a bias researcher in visualization) for @ieeevis.bsky.social Workshop on Accessibility on how using LLMs and generative models forces reliance (rather than builds trust) when used for accessibility.

UMich Ling is hiring for a cluster hire position in AI and Linguistics! Come work in a fabulous department with great grad students, supportive colleagues, and one overly school-spirited nut who will tell you where all the fun stuff is on campus. apply.interfolio.com/171006

This is the first example I've seen of a university trying to mobilize constituents to stand up against Trump threats. There's been a lot of "wHaT eLsE CaN AdMiNiStRaToRs Do?" in The Discourse when this is exactly the thing they haven't been doing. Good for UCLA for trying. Others should follow.

Really just had something like this feeling this afternoon. It’s the high that keeps you coming back for more

Excellent non-technical explanation! Let’s raise AI literacy without scaring people off with overly complicated terminology while preserving technical accuracy!

The EPFL NLP lab is looking to hire a postdoctoral researcher on the topic of designing, training, and evaluating multilingual LLMs: docs.google.com/document/d/1... Come join our dynamic group in beautiful Lausanne!

Neat year #NLP conferences: 📍 #EACL2026: 24–29 March 🇲🇦 Rabat (ARR deadline: 6 Oct) 📍 #LREC2026: 11–16 May 🇪🇸 Palma de Mallorca (deadline: 17 Oct) 📍 #ACL2026: 2–7 July 🇺🇸 San Diego (ARR deadline: 6 Jan) 📍 #COLING2027: 9–14 May 2027 🇲🇴 Macao

Only 2 out of 120 papers in my NeurIPS SAC batch have all reviewer scores ≥4! Don't despair with the low scores and focus on writing a clear and concise rebuttal! Good luck!

Woke up to a pleasant surprise! Guardian wrote a nice article covering our Binary climate data study! TLDR: “Before and after” climate data can help counter the boiling frog effect www.theguardian.com/news/2025/ju...

Headed to #CogSci2025 next week! Interested in computational cognitive science applied to climate change and real-world policy? Come find me! My lab at UCLA is recruiting 1–2 fully funded PhD students. We work on: • decision-making • climate perception • human–AI collaboration for policy design

I'm sadly not at #IC2S2 😭, but I will be at #ACL2025 in Vienna ☕️ next week!! Please spread the word that I'm recruiting prospective PhD students: lucy3.notion.site/for-prospect...

We're hiring! academicjobsonline.org/ajo/jobs/30219 The Cornell Department of Communication is hiring an Assistant Professor in Science, Environment, and Risk Communication! Applications received by September 15, 2025, will be given full consideration.

You have a budget to human-evaluate 100 inputs to your models, but your dataset is 10,000 inputs. Do not just pick 100 randomly!🙅 We can do better. "How to Select Datapoints for Efficient Human Evaluation of NLG Models?" shows how.🕵️ (random is still a devilishly good baseline)

This is the best explanation I've seen yet for _why_ language models prefer em-dashes (—). In brief: The tokenization scheme mean em-dashes result in a smaller loss than other, equivalent punctuation options. msukhareva.substack.com/p/the-myster...

Experimentology is out today!!! A group of us wrote a free online textbook for experimental methods, available at experimentology.io - the idea was to integrate open science into all aspects of the experimental workflow from planning to design, analysis, and writing.

Can you train a performant language model using only openly licensed text? We are thrilled to announce the Common Pile v0.1, an 8TB dataset of openly licensed and public domain text. We train 7B models for 1T and 2T tokens and match the performance similar models like LLaMA 1 & 2

𝐖𝐡𝐚𝐭 𝐇𝐚𝐬 𝐁𝐞𝐞𝐧 𝐋𝐨𝐬𝐭 𝐖𝐢𝐭𝐡 𝐒𝐲𝐧𝐭𝐡𝐞𝐭𝐢𝐜 𝐄𝐯𝐚𝐥𝐮𝐚𝐭𝐢𝐨𝐧? (arxiv.org/abs/2505.22830) I'm happy to announce that the preprint release of my first project is online! Developed with the amazing support of @lasha.bsky.social & @anamarasovic.bsky.social

Happy to announce the first workshop on Pragmatic Reasoning in Language Models — PragLM @ COLM 2025! 🎉 How do LLMs engage in pragmatic reasoning, and what core pragmatic capacities remain beyond their reach? 🌐 sites.google.com/berkeley.edu/praglm/ 📅 Submit by June 23rd

Our discussion period just started. Authors, please read our instructions carefully. We require responses by June 2. But, what you really want to hear about is stats .... right? -> 🧵

#jobs #stellenangebote #GESISjobs #jobfairy Our Team Digital Society Observatory in #Cologne is looking for a #SeniorResearcher & #TeamLeader in Computational Social Science #CSS (Salary group 15 TV-L, working time 100%, initially for four years with possible tenure): gesis.jobs.personio....

Google Deepmind is hiring a research scientist in Seattle to work on foundational research in language! job-boards.greenhouse.io/deepmind/job...

Do folks really find the ARR checklist valuable enough to justify that a paper submission takes this much effort?

my lab (lacns.github.io) at @mpi-nl.bsky.social and @dondersinst.bsky.social is recruiting for two PhD and two postdoctoral positions funded by an @erc.europa.eu Consolidator - come join us! PhD: www.mpi.nl/career-educa... Postdoc: www.mpi.nl/career-educa... (please share widely)

Excited to share a new preprint w/ @michael-lepori.bsky.social & Michael Franke! A dominant approach in AI/cogsci uses *outputs* from AI models (eg logprobs) to predict human behavior. But how does model *processing* (across layers in a forward pass) relate to human real-time processing? 👇 (1/12)

📣 Call for Paper Alert: TokShop @ ICML 2025 TokShop explores tokenization across all data modalities. Topics include: subword NLP techniques, multimodal approaches, multilingual challenges, post-training modification, alternative representations, and statistical perspectives.

I'm particularly fond of this new benchmark paper we wrote, which aims to scalably evaluate whether language models can generalize to arbitrary new tasks. The core idea is to use LLMs to generate new games, and then evaluate whether LLMs can play those games 📄: arxiv.org/abs/2505.07215

I'm joining Wisconsin CS as an assistant professor in fall 2026!! There, I'll continue working on language models, computational social science, & responsible AI. 🌲🧀🚣🏻‍♀️ Apply to be my PhD student! Before then, I'll postdoc for a year in the NLP group at another UW 🏔️ in the Pacific Northwest

How do language models generalize from information they learn in-context vs. via finetuning? In arxiv.org/abs/2505.00661 we show that in-context learning can generalize more flexibly, illustrating key differences in the inductive biases of these modes of learning — and ways to improve finetuning. 1/

How does the public conceptualize AI? Rather than self-reported measures, we use metaphors to understand the nuance and complexity of people’s mental models. In our #FAccT2025 paper, we analyzed 12,000 metaphors collected over 12 months to track shifts in public perceptions.

I'm at #NAACL2025 & would love to chat! On Thu, I'll be presenting our paper on LLM annotations for valid estimates in social science (oral talk @ 4pm, CSS session) 📝 Paper: aclanthology.org/2025.naacl-l... *New* 🧪 tutorial (LLMs + Prolific data collection): github.com/kristinaglig...

We won an outstanding paper award!! 2025.naacl.org/blog/best-pa...

Life update! Excited to announce that I’ll be starting as an assistant professor at Cornell Info Sci in August 2026! I’ll be recruiting students this upcoming cycle! An abundance of thanks to all my mentors and friends who helped make this possible!!

🚨 New in Nature Human Behavior! 🚨 Binary climate data visuals amplify perceived impact of climate change. Both graphs in this image reflect equivalent climate change trends over time, yet people consistently perceive climate change as having a greater impact in the right plot than the left. 👇1/n

The Department of Linguistics at Yale University is seeking to hire a one-year lecturer with expertise in Computational Linguistics and/or Syntax for the 2025-2026 school year. See the job ad for more info: linguistlist.org/issues/36/11... Please send to any who might be interested!

When we read the news, images can convey different things than text itself. Unlike other works which look at text, we study this as a “multimodal” framing problem & analyze where text and images communicate different “frames”. Checkout our paper here: arxiv.org/abs/2503.20960 @aicentre.dk

Our lab had a #dogathon 🐕 yesterday where we analyzed NYC Open Data on dog licenses. We learned a lot of dog facts, which I’ll share in this thread 🧵 1) Geospatial trends: Cavalier King Charles Spaniels are common in Manhattan; the opposite is true for Yorkshire Terriers.