Bastian Grossenbacher-Rieck about 2 months ago
It's epoch 50. Do you know whether your LLM is grokking?
In our #NeurIPS2025 paper "Less is More: Local Intrinsic Dimensions of Contextual Language Models," we study how the local intrinsic dimension (LID) of embeddings changes during training and fine-tuning.
#research
🧵1/n
