Scattering Vision Transformer: Spectral Mixing Matters

Existing solutions often resort to down-sampling operations, such as pooling, to reduce computational cost. Unfortunately, such operations are non-invertible and can result in information loss.