📢 Unhappy about peer review at NLP/ML conferences? Here's a chance to do smth about it, and get an interdisciplinary PhD! NLP+discrete optimization at @itu.dk Project: interpretable methods for paper-reviewer matching Apply by Jan 6 for position DC6: www.cords-dn.at Master degree needed

Want to teach AI agents to use apps like humans? Get started with digital agents research using OpenApps, our new Python-based environment.

This is super cool! I had been contemplating starting a project like this a few years ago to actualize a vague interest I have in the math of knots... but this benchmark is probably much better than I could've managed. Can't wait to take a closer look 🪢!

We've create a simple and easy framework for documenting AI evaluation methods! Check it out and submit some for your own datasets with a PR! You can learn more here: github.com/facebookrese... And here: arxiv.org/abs/2512.04062

My spouse is doing a week of science communication (in German) this week. Topics may include cognitive science, linguistics, AI, political economy, science and technology studies, maybe even some philosophy too. Check it out👨‍🔬!

🤖🧠I'll be considering applications for PhD students & postdocs to start at Yale in Fall 2026! If you are interested in the intersection of linguistics, cognitive science, & AI, I encourage you to apply! PhD link: rtmccoy.com/prospective_... Postdoc link: rtmccoy.com/prospective_...

New work to appear @ TACL! Language models (LMs) are remarkably good at generating novel well-formed sentences, leading to claims that they have mastered grammar. Yet they often assign higher probability to ungrammatical strings than to grammatical strings. How can both things be true? 🧵👇

Please respond to this survey if you have changed or have thought about changing your name in academic publishing! For any reason, whether it be transition, recognizability, marriage, privacy, immigration, cultural reasons, etc. Please RT for reach :)

UT Austin Linguistics is hiring in computational linguistics! Asst or Assoc. We have a thriving group sites.utexas.edu/compling/ and a long proud history in the space. (For instance, fun fact, Jeff Elman was a UT Austin Linguistics Ph.D.) faculty.utexas.edu/career/170793 🤘

We wrote a thing about AI, fascism, and why framing this as "hype" is too apolitical www.liberalcurrents.com/deflating-hy...

Our team is hiring a postdoc in (mechanistic) interpretability! The ideal candidate will have research experience in interpretability for text and/or image generation models and be excited about open science! Please consider applying or sharing with colleagues: metacareers.com/jobs/2223953961352324

Ingeborg and I wrote a thing about "hype", and why we think that framing AI through that lens is increasingly inadequate - check it out!

Have you heard about this year's shared task? 📢 Mechanistic Interpretability (MI) is quickly advancing, but comparing methods remains a challenge. This year at #BlackboxNLP, we're introducing a shared task to rigorously evaluate MI methods in language models 🧵

Excited to share the IntPhys 2.0 benchmark for intuitive physics understanding of video! It's super challenging for models but not humans, making it a great testbed for pushing modeling improvements. Check it out: ai.meta.com/research/pub...

Come by to our panel at APS to share your thoughts, and ask us all the hard stuff!

Check it out! Guy et al. explores the impact of format on function vectors, and invites further conversation about what it would mean to have universal goal representations in LLMs. (I've hung around interp communities for a while but this is my 1st mech-interp project. feedback much appreciated!)

COLM 2025 workshops are announced now, check it out: colmweb.org/Workshops.html

Pls come to my book launch on May 22, 5pm, at Newnham College Cambridge cohosted w @mctd.bsky.social and @cfi-cambridge.bsky.social and with stellar discussants @gsvoss.bsky.social and Jennifer Schooling Register here: lu.ma/9vm405sk

This is such a fun example of LM weirdness (which also shows how they match form over fact!) More linguistically: it looks like ending a query with "meaning" triggers the bot to accommodate the presupposition that the input contains an idiom! (Hard to run normal preposition tests here tho)

Happy to be at CUNY today to workshop about the theoretical foundations of AI! Fun to have several perspectives---math, philosophy, linguistics and more---together in one place! w/@giannig.bsky.social @seiller.bsky.social J. Terilla et al. itsatcuny.org/calendar/202...

Happy to share that the paper describing the AILuminate v1.0 benchmark is now out! arxiv.org/abs/2503.05731 The benchmark is designed with @mlcommons.org to assess LLM risk and reliability across 12 hazard categories. AILuminate is available for testing models and helping ensure safer deployment!

Our book "Why We Fear AI" is out today! Hopefully it can help make sense out of some of the terrifying stuff that's happening these days, and what AI and capitalism have to do with it! Get it directly from the publisher or wherever you get your books! www.commonnotions.org/why-we-fear-ai

WHY WE FEAR AI is out today! Industry insiders @hagenblix.bsky.social and Ingeborg Glimmer dive into the dark, twisted world of AI to demystify the many nightmares we have about it. One of the best ways to face your fear is to confront it—order a copy of WHY WE FEAR AI: buff.ly/1tWhkx8

Why Official English is a terrible idea for the United States, from @lingsocam.bsky.social. Like and share! www.lsadc.org/content.asp?...

I just interviewed @hagenblix.bsky.social for The Data Fix (episode out early April) and my mind is blown. Please go buy their book: www.amazon.ca/gp/product/1...

My spouse co-wrote a book! It's about AI and what peoples' fears about it actually mean. Go check it out 👇

Two new studies from our team we're particularly happy about: Study 1: ai.meta.com/research/pub... Study 2: ai.meta.com/research/pub... Blog 3: ai.meta.com/blog/brain-a...

We had two papers accepted at NAACL'25! 🥳 - Improving model evaluation using SMART filtering of benchmark datasets (Gupta et al. arxiv.org/pdf/2410.20245) - On the role of speech data in reducing toxicity detection bias (Bell et al. arxiv.org/pdf/2411.08135)

My spouse co-wrote a book about AI! Of course, I'm biased, but I think there's a TON of thought provoking stuff inside. Check it out/preorder 👇

Another post #LSA2025 thought: what's going on linguistically with "at scale" ("at a large enough scale for XYZ"). And maybe it's generalizing? "implement [AI] safely as they move at pace” www.theguardian.com/politics/2025/jan/12/mainlined-into-uks-veins-labour-announces-huge-public-rollout-of-ai

On the heels of #LSA2025 I read M. Tavakoli's simply fascinating piece on ventriloquism. An articulatory study of ventriloquist performance would be *so* cool! Feels like a goldmine for sociophon + maybe even wild new data on McGurk? Someone do it pls! Read here: www.nplusonemag.com/issue-49/ess...

Excited to present in-process work on the syntactic complexity of LM outputs with Dexter Ju & @hagenblix.bsky.social at #LSA2025 in Philadelphia! Come on by Salon H in 30 min to chat about LMs and what they mean for cognitive science and linguistics! Learn more here: web.cvent.com/event/40d941...

Announcement #2: our call for workshops is up! 💥 colmweb.org/cfw.html And excited to announce the first ever workshop chairs for COLM..... 🥁🥁🥁 COLM 2025 workshops will be led by Colin Raffel and @adinawilliams.bsky.social Workshop proposal deadline is April 14 🗓️

Check it out! The reproducibility challenge is going physical! Hope to see some of you in Princeton in Aug '25

Our paper PRISM alignment won a best paper award at #neurips2024! All credits to @hannahrosekirk.bsky.social A.Whitefield, P.Röttger, A.M.Bean, K.Margatina, R.Mosquera-Gomez, J.Ciro, @maxbartolo.bsky.social H.He, B.Vidgen, S.Hale Catch Hannah tomorrow at neurips.cc/virtual/2024/poster/97804

🎓 Checkout the #MLRC2023 posters at #NeurIPS 2024 this week: reproml.org/proceedings/ Also, important announcement for the next iteration coming this week! #MLSky #TMLR

So happy to see this benchmark launch! It's been a huge effort from so many contributors for months and months. Having broad-based coalition support for standardizing safety tools is an important step towards improving AI tools across the industry. Check it out!

#intro Looking forward to trying a new thing! Probably I'll post mostly about NLP and AI, with some linguistics and cognitive science thrown in for good measure.