Softmax Classifiers Explained - PyImageSearch

Last week, we discussed Multi-class SVM loss; specifically, the hinge loss and squared hinge loss functions. A loss function, in the context of Machine Learning and Deep Learning, allows us to quantify how "good" or "bad" a given classification function (also called a "scoring function") is at correctly classifying data points in our dataset. In fact, if you have done previous work in Deep Learning, you have likely heard of this function before -- do the terms Softmax classifier and cross-entropy loss sound familiar? I'll go as far to say that if you do any work in Deep Learning (especially Convolutional Neural Networks) that you'll run into the term "Softmax": it's the final layer at the end of the network that yields your actual probability scores for each class label. To learn more about Softmax classifiers and the cross-entropy loss function, keep reading.