We would like to thank the reviewers for their detailed and insightful comments

We would like to thank the reviewers for their detailed and insightful comments. We have resolved the concerns with SGD. We have similar results with Adam. Gaussian sketch performs better than SVRG on problem (1), and is robust to the choice of hyperparameters. We will include these results in the final version.