Black-BoxGeneralization: StabilityofZeroth-OrderLearning

Forboundednonconvex losses and a batch sizem = 1, we additionally show that both generalization error and learning rate are independent ofd and K, and remain essentially the same asfortheSGD, evenfortwofunction evaluations.