Supplementary Material: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers Wenhui Wang Furu Wei

Oct-2-2025, 18:08:26 GMT–Neural Information Processing Systems 

Given an input passage and an answer, the task is to generate a question that asks for the answer.