Empirical Evaluation of Knowledge Distillation from Transformers to Subquadratic Language Models

Open in new window