Stochastic and Adversarial Online Learning without Hyperparameters

Ashok Cutkosky, Kwabena A. Boahen

Neural Information Processing Systems 

The algorithm's objective is to minimize regret, which is the total loss of all rounds relative to