On-the-Fly Adaptive Distillation of Transformer to Dual-State Linear Attention

Open in new window