On the impact of activation and normalization in obtaining isometric embeddings at initialization

Open in new window