Understanding the Gains from Repeated Self-Distillation
–Neural Information Processing Systems
Self-Distillation is a special type of knowledge distillation where the student model has the same architecture as the teacher model.
Neural Information Processing Systems
Oct-9-2025, 18:37:27 GMT
- Country:
- Asia > Middle East
- Jordan (0.04)
- Europe > Italy (0.04)
- North America > United States
- Washington > King County > Seattle (0.04)
- Asia > Middle East
- Genre:
- Research Report > Experimental Study (0.93)
- Industry:
- Education (0.48)
- Information Technology (0.46)
- Technology: