Appendix to " Adam with Bandit Sampling for Deep Learning "