Squeezeformer: An Efficient Transformer for Automatic Speech Recognition

Layer Normalization operations, and (iii) incorporates an efficient depthwise down-sampling layer to efficiently sub-sample the input signal.