Appendix

We extra define the following notations for the proof. In Assumption 3.2, we assume the Lipschitz continuity and smoothness for In the proof of lemmas, e.g., Lemma B.1 and B.2, we only use the fact We give a table of notations that will be frequently used (See Table 1). Neural networks with randomly dropped edges. See the proof in Appendix H . By Lemma B.1, with probability at least 1 exp( (log Note that the above results hold for any ` L .