Shadow Knowledge Distillation: Bridging Offline and Online Knowledge Transfer Lujun Li
–Neural Information Processing Systems
KD aims to transfer knowledge from a high-capacity large model ( i.e., teacher) to a low-capacity
Neural Information Processing Systems
Dec-27-2025, 16:17:51 GMT
- Genre:
- Research Report > New Finding (0.46)
- Industry:
- Education (0.69)
- Technology:
- Information Technology > Artificial Intelligence
- Machine Learning > Neural Networks (0.94)
- Natural Language (0.67)
- Vision (0.95)
- Information Technology > Artificial Intelligence