Why Training a Neural Network Is Hard

Fitting a neural network involves using a training dataset to update the model weights to create a good mapping of inputs to outputs. This training process is solved using an optimization algorithm that searches through a space of possible values for the neural network model weights for a set of weights that results in good performance on the training dataset. In this post, you will discover the challenge of training a neural network framed as an optimization problem. Why Training a Neural Network Is Hard Photo by Loren Kerns, some rights reserved. Deep learning neural network models learn to map inputs to outputs given a training dataset of examples.