WhatMakesa" Good" DataAugmentationin KnowledgeDistillation-AStatisticalPerspective (withAppendix)

Deep neural networks (DNNs) are the de facto methodology in many artificial intelligence areas nowadays [25, 37]. How to effectively train a deep network has been a central topic for decades.