LearningaSingleNeuronwithBias UsingGradientDescent

Learning a single ReLU neuron with gradient descent is a fundamental primitive in the theory of deep learning, andhasbeen extensivelystudied inrecent years.