QT-ViT: Improving Linear Attention in ViT with Quadratic Taylor Expansion
–Neural Information Processing Systems
In this paper, we propose QT -ViT models that improve the previous linear self-attention using quadratic Taylor expansion.
Neural Information Processing Systems
Feb-16-2026, 19:42:45 GMT
- Genre:
- Research Report > Experimental Study (0.93)
- Technology:
- Information Technology > Artificial Intelligence
- Machine Learning > Neural Networks (0.93)
- Natural Language (1.00)
- Vision (1.00)
- Information Technology > Artificial Intelligence