If You Want to Be Robust, Be Wary of Initialization

We introduce a theoretical framework bridging the connection between initialization strategies and a network's resilience to adversarial perturbations.