SupplementaryMaterial
–Neural Information Processing Systems
Following that original shortcut connections exist in both MSA and MLP modules, the proposed augmented shortcuts are also embedded into the MLP module (Eq.
Neural Information Processing Systems
Feb-9-2026, 14:06:19 GMT