Emmanuel Mourlon-Druol (@manumourlon.bsky.social)

Mapping the Latent Past: Assessing Large Language Models as Digital Tools through Source Criticism This article examines how digital historians can use large language models (LLMs) as research tools while critically assessing their limitations through source criticism of their underlying training data. Case studies of LLM performance on historical knowledge benchmarks, oral history transcriptions, and OCR corrections reveal how these technologies encode patterns of whose history has been digitised and made computationally legible. These variations in performance across linguistic and temporal domains reveal the uneven terrain of knowledge encoded within generative AI systems. By mapping this "jagged frontier" of AI capabilities, historians can evaluate LLMs not just as tools but as historical sources shaped by the scale and diversity of their training. The article concludes by examining how historians can develop new forms of source criticism to navigate generative AI's uneven potential while contributing to broader debates about these technologies' societal impact. https://journalofdigitalhistory.org/en/article/JZx9gw7iwGxb