Do you know that you can continue pretraining Instructed LLMs without losing their instruction following capabilities?
We did so to teach Basque to Llama models with promising results!
Interestingly, you only need English instructions and target language corpora 🤯
1/3
add a skeleton here at some point
9 months ago