Stand-Alone Self-Attention in Vision Models

Niki Parmar, Prajit Ramachandran, Ashish Vaswani, Irwan Bello, Anselm Levskaya, Jon Shlens

Feb-11-2026, 21:07:50 GMT–Neural Information Processing Systems

Detailed ablation studies demonstrate thatself-attention isespecially impactful when used inlater layers. These results establish that stand-alone self-attention is an important addition to the vision practitioner'stoolbox.

artificial intelligence, arxivpreprintarxiv, machine learning, (18 more...)

Neural Information Processing Systems

Feb-11-2026, 21:07:50 GMT

Conferences PDF

Country:
- Asia > Japan
  - Honshū > Tōhoku > Fukushima Prefecture > Fukushima (0.04)
- North America
  - Canada
    - British Columbia > Metro Vancouver Regional District
      - Vancouver (0.04)
    - Ontario > Toronto (0.04)
  - United States > District of Columbia
    - Washington (0.04)

Technology:
- Information Technology
  - Artificial Intelligence
    - Machine Learning > Neural Networks (1.00)
    - Vision (1.00)
  - Sensing and Signal Processing > Image Processing (1.00)

Duplicate Docs Excel Report

Title
Stand-Alone Self-Attention in Vision Models
Stand-Alone Self-Attention in Vision Models

Similar Docs Excel Report more

Title	Similarity	Source
None found