vision transformer
ViTAE: VisionTransformerAdvancedbyExploring IntrinsicInductiveBias
Alternatively,theyrequire large-scale training data and longer training schedules to learn the IB implicitly.
Technology:
Transformer in Transformer Kai Han 1,2 An Xiao 2 Enhua Wu
Features of both words and sentences will be aggregated to enhance the representation ability.
Technology:
- Information Technology > Sensing and Signal Processing > Image Processing (1.00)
- Information Technology > Artificial Intelligence > Vision (1.00)
- Information Technology > Artificial Intelligence > Natural Language (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (1.00)
Country:
- Asia > China > Shanghai > Shanghai (0.04)
- North America > United States > Massachusetts > Middlesex County > Cambridge (0.04)
- Asia > China > Hong Kong (0.04)
Technology:
- Information Technology > Sensing and Signal Processing > Image Processing (1.00)
- Information Technology > Artificial Intelligence > Vision (1.00)
- Information Technology > Artificial Intelligence > Natural Language (0.93)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks (0.46)
DeSparsify: Adversarial Attack Against Token Sparsification Mechanisms
Vision transformers have contributed greatly to advancements in the computer vision domain, demonstrating state-of-the-art performance in diverse tasks ( e.g.,
Genre:
- Research Report > Experimental Study (0.93)
- Research Report > New Finding (0.67)
Technology:
Country:
- Europe > Switzerland > Zürich > Zürich (0.14)
- Asia > Singapore (0.04)
- Europe > Romania > Sud - Muntenia Development Region > Giurgiu County > Giurgiu (0.04)
- Asia > China > Guangxi Province > Nanning (0.04)
Genre:
- Research Report > New Finding (0.93)
- Research Report > Experimental Study (0.93)
Technology:
Country:
- Europe > Switzerland > Zürich > Zürich (0.14)
- Asia > China (0.04)
- Asia > Middle East > Israel (0.04)
Technology:
Country:
- South America > Chile > Santiago Metropolitan Region > Santiago Province > Santiago (0.04)
- North America > United States > Texas (0.04)
- Asia > China > Jiangsu Province > Nanjing (0.04)
Industry:
- Health & Medicine (1.00)
- Information Technology (0.67)
Technology:
Country:
- Europe > Switzerland > Zürich > Zürich (0.04)
- Europe > Slovenia > Drava > Municipality of Benedikt > Benedikt (0.04)
Technology:
Stability Guarantees for Feature Attributions with Multiplicative Smoothing
In this work, we analyze stability as a property for reliable feature attribution methods.
Country:
- Europe > Switzerland > Zürich > Zürich (0.14)
- North America > United States > Pennsylvania > Philadelphia County > Philadelphia (0.04)
Industry:
- Law (0.46)
- Health & Medicine > Diagnostic Medicine (0.46)
Technology:
QT-ViT: Improving Linear Attention in ViT with Quadratic Taylor Expansion
In this paper, we propose QT -ViT models that improve the previous linear self-attention using quadratic Taylor expansion.
Technology: