Subcritical Signal Propagation at Initialization in Normalization-Free Transformers

Open in new window