A definitive explanation to Hinge Loss for Support Vector Machines.

NOTE: This article assumes that you are familiar with how an SVM operates. If this is not the case for you, be sure to check my out previous article which breaks down the SVM algorithm from first principles, and also includes a coded implementation of the algorithm from scratch! I have seen lots of articles and blog posts on the Hinge Loss and how it works. However, I find most of them to be quite vague and not giving a clear explanation of what exactly the function does and what it is. Instead, most of the time an unclear graph is shown and the reader is left bewildered.