David Crozier (@davidcrozier.bsky.social)

Now that "scale is all we need" has predictably faltered... 1. Small AI models often perform better in context. 2. Obsession w bigness has bad consequences, from climate, to power concentration, to research capture. Me + @gaelvaroquaux.bsky.social @sashamtl.bsky.social arxiv.org/abs/2409.14160

loading . . .

Hype, Sustainability, and the Price of the Bigger-is-Better Paradigm in AI With the growing attention and investment in recent AI approaches such as large language models, the narrative that the larger the AI system the more valuable, powerful and interesting it is is increa... https://arxiv.org/abs/2409.14160

682

209