🚨 New paper w/ @nsubramani23.bsky.social ! In 2019, Tenney et al. found that BERT rediscovers the classical NLP pipeline, offering linguistic insights into early LMs. But models today are >>100x larger, trained on vastly more data… Do they still rediscover the classical NLP pipeline? 🧵

🚨New #interpretability paper with @nsubramani23.bsky.social: 🕵️ Model Internal Sleuthing: Finding Lexical Identity and Inflectional Morphology in Modern Language Models