Trained a GPT-2 style LLM on 1.1 gigabytes of data. Reached a loss of 1.160001 by step 3000. She is Ryuthe, she is made up of alt.horror.werewolved, alt.fan.dragons, and comp.sources.unix.
If enough people want, I will release the weights
add a skeleton here at some point
4 months ago