🚨Calling all fans of analyzing neural networks: There will be a workshop at Yale in the spring that you should come to! (May 11 to May 13)

Announcing the first Workshop on Formal Languages and Neural Networks (FLaNN)! We invite the submission of abstracts for posters that discuss the formal expressivity, computational properties, and learning behavior of neural network models, including large language models (LLMs).

These products flagrantly violate the rules of English compounds! "Reese's Oreo" should be a type of Oreo, not a type of Reese's!

Congratulations to all of the new ACL fellows!! I'm delighted to see @lorislevin.bsky.social recognized. She's the person who introduced me to computational linguistics, and my scientific outlook has been deeply shaped by her views on the relationship between linguistics & NLP. 1/n

A fantastic department - highly recommend applying!

Me giving my account number to a customer service rep: "That's 2 as in twenty-three, 7 as in seven hundred six, 1 as in fourteen, 1 as in fourteen, 0 as in...well...uh..."

Still waiting for Google to release Ge (the large version of Gemini)

Come be my colleague! The Yale Dept of Linguistics is hiring a 3-year Lecturer in Historical Linguistics. There's a great group here working on language change, and you could become part of it! Application review begins Dec 14. For more info, see apply.interfolio.com/177395

Do any languages have different forms of "and" for different phrase types? English uses "and" no matter what's being joined: "bread and butter" (nouns), "divide and conquer" (verbs), "short and sweet" (adjs). Are there languages that vary the conjunction across these contexts?

🤖🧠I'll be considering applications for PhD students & postdocs to start at Yale in Fall 2026! If you are interested in the intersection of linguistics, cognitive science, & AI, I encourage you to apply! PhD link: rtmccoy.com/prospective_... Postdoc link: rtmccoy.com/prospective_...

Who's up for a short thread demonstrating just how wrong this claim is by Mistral's CEO, using research by @rtommccoy.bsky.social (an co-authors) regarding crossword puzzles? Just me? Well whatever, let's dive into a mini-exploration of the Embers of Autoregression and why they singe...

I’m excited to share our Findings of EMNLP paper w/ @cocoscilab.bsky.social , @rtommccoy.bsky.social, and @rdhawkins.bsky.social ! Language models, unlike humans, require large amounts of data, which suggests the need for an inductive bias. But what kind of inductive biases do we need?

An exciting postdoc opportunity for researchers in CogSci! The deadline is coming up soon: Nov 10

Come be my colleague! The Wu Tsai Institute at Yale has two faculty searches ongoing: - One in computational cognitive science (due Dec 1) - One in neurodevelopment (rolling) 🧠🤖

Much as "cupboard" is pronounced "cubberd", I think that "clipboard" should be pronounced "clibberd"

Beginning a Grand Tour of California! - Oct 6: Colloquium at Berkeley Linguistics - Oct 9: Workshop at Google Mountain View - Oct 14: Talk at UC Irvine Center for Lg, Intelligence & Computation - Oct 16: NLP / Text-as-Data talk at NYU Say hi if you'll be around!

Exciting talk in the linguistics department at UC Berkeley tomorrow! @rtommccoy.bsky.social

🤖 🧠 NEW BLOG POST 🧠 🤖 What skills do you need to be a successful researcher? The list seems long: collaborating, writing, presenting, reviewing, etc But I argue that many of these skills can be unified under a single overarching ability: theory of mind rtmccoy.com/posts/theory...

"Hello world!" sounds like a word followed by a crossword clue for that word: "Hell = Low world"

A linguistic note about David Copperfield and Demon Copperhead 🧵 [very minor spoilers for both] 1/n

New position paper! We argue that symbolic and neural network models are not in opposition to each other, but occupy different levels of analysis, and also outline a new research agenda for better understanding the relationship between them. Please check out the paper / thread for more details!

🤖 🧠 NEW PAPER ON COGSCI & AI 🧠 🤖 Recent neural networks capture properties long thought to require symbols: compositionality, productivity, rapid learning So what role should symbols play in theories of the mind? For our answer...read on! Paper: arxiv.org/abs/2508.05776 1/n

According to Jane Austen, linguists are extraordinarily cold-hearted. (Though at least we're not as bad as mathematicians!)

So much research is being done about LLMs that it's hard to stay on top of the literature. To help with this, I've made a list of all the most important papers from the past 8 years: rtmccoy.com/pubs/ I hope you enjoy!

July the 4th be with you!

New paper: "Large Language Models and Emergence: A Complex Systems Perspective" (D. Krakauer, J. Krakauer, M. Mitchell). We look at claims of "emergent capabilities" & "emergent intelligence" in LLMs from the perspective of what emergence means in complexity science. arxiv.org/pdf/2506.11135

The word "laundry" contains both steps of the laundry process: 1. Undry 2. Dry

Happy to announce the first workshop on Pragmatic Reasoning in Language Models — PragLM @ COLM 2025! 🎉 How do LLMs engage in pragmatic reasoning, and what core pragmatic capacities remain beyond their reach? 🌐 sites.google.com/berkeley.edu/praglm/ 📅 Submit by June 23rd

Had a fun visit to UChicago/TTIC over the past couple days - really great group doing NLP/CompLing there!

🤖🧠 Paper out in Nature Communications! 🧠🤖 Bayesian models can learn rapidly. Neural networks can handle messy, naturalistic data. How can we combine these strengths? Our answer: Use meta-learning to distill Bayesian priors into a neural network! www.nature.com/articles/s41... 1/n

At MIT for the day to speak at the NLP seminar! Say hi if you're around and need a break from NeurIPS drafting!

I constructed today's NYT crossword! This one has some personal connections, described at the WordPlay article by @samcorbin.bsky.social (contains spoilers): www.nytimes.com/2025/05/06/c... I hope you enjoy!

🧩🦾New paper🦾🧩 We use Linguistics Olympiad puzzles to test Large Language Models Check it out if you're at NAACL! It's being presented by Nathan Chi at 4:00 today in the LoResMT workshop aclanthology.org/2025.loresmt...

Made a new assignment for a class on Computational Psycholinguistics: - I trained a Transformer language model on sentences sampled from a PCFG - The students' task: Given the Transformer, try to infer the PCFG (w/ a leaderboard for who got closest) Would recommend! 1/n

The past few years have been a wild time to work in NLP - huge amounts of progress, hype, uncertainty, and excitement. This piece does a fantastic job of documenting what that's been like. I had fun being one of the interviewees! By John Pavlus in @quantamagazine.bsky.social

The initial application deadline is coming up (April 30 - but we will continue to review applications until the position is filled, so it's worth applying even if a little after that). Please share with any computational linguists and/or syntacticians who may be interested!

The Department of Linguistics at Yale University is seeking to hire a one-year lecturer with expertise in Computational Linguistics and/or Syntax for the 2025-2026 school year. See the job ad for more info: linguistlist.org/issues/36/11... Please send to any who might be interested!

I'm excited to be visiting UPenn tomorrow to speak at the ILST Seminar! Come by if you'll be around! web.sas.upenn.edu/lcs/news-eve...

Cognitive scientists who work across levels of analysis should be called Marr's Rovers

🤖🧠New paper!🧠🤖 A common assumption: In neural networks, "inductive bias" = "model architecture" But in fact initial weights also greatly influence inductive bias! This makes it possible for the same bias to be realized in very different architectures - albeit w/ limits arxiv.org/abs/2502.20237

Excited to announce that the (stellar!) program for NASSLLI is out now: nasslli25.shane.st Further details on registration and whatnot to follow in the coming weeks. Please do circulate to anyone you know who may be interested in attending!

The "ash heap of history" is where we store all the æ's that are no longer used in English spelling

A skill for academics that might become valuable in the coming years: LLM SEO. That is, writing your papers in a way that will get Deep Research to like them (I hope that this won't actually matter....but I wouldn't be surprised if it does. Could really influence the reach your work has.)

LMs need linguistics! New paper, with @futrell.bsky.social, on LMs and linguistics that conveys our excitement about what the present moment means for linguistics and what linguistics can do for LMs. Paper: arxiv.org/abs/2501.17047. 🧵below.

I added a new assignment to my Computational Linguistics class last semester: - Choose a linguistic phenomenon in a language other than English - Give a 3-minute presentation about that phenomenon & how it would pose a challenge for computational models Would recommend! 1/n

🔥While LLM reasoning is on people's minds... Here's a shameless plug for our work comparing o1 to previous LLMs (extending "Embers of Autoregression"): arxiv.org/abs/2410.01792 - o1 shows big improvements over GPT-4 - But qualitatively it is still sensitive to probability 1/4

My commentary on the do's and don'ts of cognitive evaluations in LLMs is now out in Nature Human Behavior: doi.org/10.1038/s415... posting here with a figure that didn't make it into the final draft and is now instead a boring table :P #CogSci #LLMs #AI

🪐 🚀 Physics 🚀 🪐 The universe is fundamentally discrete (quantum mechanics), but at a high level it's approximately continuous (classical mechanics) 🤖 🧠 Cognitive science 🧠 🤖 The mind is fundamentally continuous (the brain), but at a high level it's approximately discrete (symbols)

Since the Odyssey is in the news, here's an anecdote: When I was 14 or so, I noticed a book on our kitchen table with the title ODYSSEY. But a couple things about the book were odd... 1/3

Next was an excellent talk by @rtommccoy.bsky.social on using training data statistics to examine how many LLM generations are exact replicas of the training data at the Simons Institute www.youtube.com/watch?v=3c9T... (4/7