Passive Agressive Algorithms -- koaning.io

In a previous document I described how bayesian models can recursively update, thus making them ideal as a starting point for designing streaming machine learning models. In this document I will describe a different method proposed by Crammer et al. which includes a passive agressive approach to model updates. I will focus on intuition first before moving to the mathy bits. Let's say you're doing a regression for a single data point $d_i$. If you only have one datapoint then you don't know what line is best.