agentic learning ai lab (@agentic-ai-lab.bsky.social)

NYU Center for Data Science 8 months ago

New research by CDS MS student Amelia (Hui) Dai, PhD student Ryan Teehan, and Asst. Prof. Mengye Ren (@mengyer.bsky.social) shows that models’ accuracy on current events drops 20% over time—even when given the source articles. Presented at #NeurIPS2024. nyudatascience.medium.com/language-mod...

loading . . .

Language Models’ Prediction of Current Events Degrades Over Time, Even With Latest Information Language models lose accuracy on predicting events over time, even with access to up-to-date information. https://nyudatascience.medium.com/language-models-prediction-of-current-events-degrades-over-time-even-with-latest-information-e2dea5f2e764