Supplemental Material for What Neural Networks Memorize and Why A Proof of Lemma 2.1