Somin W
@sominw.bsky.social
📤 31
📥 71
📝 6
cs phd @ northeastern. opinions on new england & beyond..
📢 Can we trace a small distilled model back to its teacher? 🤔New work (w/
@chantalsh.bsky.social
,
@silvioamir.bsky.social
&
@byron.bsky.social
) finds some footprints left by LLMs in distillation! [1/6] 🔗 Full paper:
arxiv.org/abs/2502.06659
loading . . .
Who Taught You That? Tracing Teachers in Model Distillation
Model distillation -- using outputs from a large teacher model to teach a small student model -- is a practical means of creating efficient models for a particular task. We ask: Can we identify a stud...
https://arxiv.org/abs/2502.06659
8 months ago
1
7
2
you reached the end!!
feeds!
log in
