The Sequence Knowlege #907: The Brain Transplant: Distilling Transformers Into Other Architectures

Weird but more common than you think. The type of distillation you were not thinking about.