Statistical Learning
The Implicit Bias of AdaGrad on Separable Data
We study the implicit bias of AdaGrad on separable linear classification problems.
Optimal Stochastic and Online Learning with Individual Iterates
Yunwen Lei, Peng Yang, Ke Tang, Ding-Xuan Zhou
Neural Information Processing Systems http://nips.cc/
LearningaSingleNeuronwithBias UsingGradientDescent
Learning a single ReLU neuron with gradient descent is a fundamental primitive in the theory of deep learning, andhasbeen extensivelystudied inrecent years.