(@davidgrangier.bsky.social)

#NeurIPS2025. Mixing different datasets to train your LLM? ✨ We can help you find the perfect blend! 📈 Few small-model experiments → scaling law fit → your optimal mixture. 🎯 Easy + efficient. Chat with us 💬 Poster #3414. Thu, Dec 4, 11am arxiv.org/abs/2507.09404

loading . . .

Scaling Laws for Optimal Data Mixtures Large foundation models are typically trained on data from multiple domains, with the data mixture--the proportion of each domain used--playing a critical role in model performance. The standard appro... https://arxiv.org/abs/2507.09404

about 1 month ago