π¨ New paper w/
@nsubramani23.bsky.social !
In 2019, Tenney et al. found that BERT rediscovers the classical NLP pipeline, offering linguistic insights into early LMs.
But models today are >>100x larger, trained on vastly more dataβ¦
Do they still rediscover the classical NLP pipeline? π§΅