KDGAN: Knowledge Distillation with Generative Adversarial Networks

Xiaojie Wang, Rui Zhang, Yu Sun, Jianzhong Qi

Neural Information Processing Systems 

Another example application is unlocking mobile phones by face recognition.