Appendix: On the Overlooked Structure of Stochastic Gradients