Transformers Meet Hyperspectral Imaging: A Comprehensive Study of Models, Challenges and Open Problems
Zhang, Guyang, Abdulla, Waleed
–arXiv.org Artificial Intelligence
Transformers have become the architecture of choice for learning long-range dependencies, yet their adoption in hyperspectral imaging (HSI) is still emerging. We reviewed more than 300 papers published up to 2025 and present the first end-to-end survey dedicated to Transformer-based HSI classification. The study categorizes every stage of a typical pipeline-pre-processing, patch or pixel tokenization, positional encoding, spatial-spectral feature extraction, multi-head self-attention variants, skip connections, and loss design-and contrasts alternative design choices with the unique spatial-spectral properties of HSI. We map the field's progress against persistent obstacles: scarce labeled data, extreme spectral dimensionality, computational overhead, and limited model explainability. Finally, we outline a research agenda prioritizing valuable public data sets, lightweight on-edge models, illumination and sensor shifts robustness, and intrinsically interpretable attention mechanisms. Our goal is to guide researchers in selecting, combining, or extending Transformer components that are truly fit for purpose for next-generation HSI applications.
arXiv.org Artificial Intelligence
Jun-11-2025
- Country:
- Africa
- Asia
- China > Jiangsu Province
- Xuzhou (0.04)
- Japan > Honshū
- Kantō > Tokyo Metropolis Prefecture > Tokyo (0.14)
- Singapore (0.04)
- Vietnam > Thái Nguyên Province
- Thái Nguyên (0.04)
- China > Jiangsu Province
- Atlantic Ocean > Gulf of Mexico (0.04)
- Europe
- Germany > Brandenburg
- Potsdam (0.04)
- Switzerland (0.04)
- Germany > Brandenburg
- North America
- Mexico (0.04)
- United States
- Mississippi (0.04)
- Texas > Harris County
- Houston (0.04)
- Oceania > New Zealand
- North Island > Auckland Region > Auckland (0.04)
- Genre:
- Overview (1.00)
- Research Report (1.00)
- Industry:
- Energy (1.00)
- Health & Medicine
- Diagnostic Medicine > Imaging (0.46)
- Therapeutic Area > Oncology (0.45)
- Technology:
- Information Technology
- Artificial Intelligence
- Machine Learning
- Neural Networks > Deep Learning (1.00)
- Statistical Learning (1.00)
- Natural Language (1.00)
- Representation & Reasoning (1.00)
- Vision (1.00)
- Machine Learning
- Data Science > Data Mining (1.00)
- Sensing and Signal Processing > Image Processing (1.00)
- Artificial Intelligence
- Information Technology