TeachLess, LearnMore: OntheUndistillableClassesinKnowledgeDistillation
–Neural Information Processing Systems
A counter-intuitive observation is that a more expansive teacher does not make a better student, but the reasons for this phenomenon remain unclear.
Neural Information Processing Systems
Feb-12-2026, 00:31:51 GMT