ComprehensiveKnowledgeDistillation withCausalIntervention

Although theteacher haslearned rich and powerful representations, it also contains unignorable bias knowledge which is usually induced by the context prior (e.g., background) in the training data.