Introducing nanoAhaMoment: Karpathy-style, single file RL for LLM library (<700 lines)
- super hackable
- no TRL / Verl, no abstraction๐โโ๏ธ
- Single GPU, full param tuning, 3B LLM
- Efficient (R1-zero countdown < 10h)
comes with a from-scratch, fully spelled out YT video [1/n]
11 months ago