Our result that OASM, a trivial model of temporal autocorrelation, achieves higher neural predictivity than GPT2-XL on the Pereira2018 dataset has been replicated thanks to @kartikpradeepan.bsky.social! Interested if @mschrimpf.bsky.social thinks this changes conclusions from Schrimpf et al., 2021.

This post has generated a super interesting debate between the authors of the paper @ebrahimfeghhi.bsky.social @nrhadidi.bsky.social and one of the authors of a paper they criticised @mschrimpf.bsky.social including an attempted reproduction of their results. This is such a great use of social media

This paper shows alignment between LLMs and brain data is outperformed by a null model. More evidence for the argument I've been making in talks lately that we shouldn't believe any computational paper that puts less effort into null than main model. www.biorxiv.org/content/10.1...