Boltzmann Exploration Done Right

Nicolò Cesa-Bianchi, Claudio Gentile, Gabor Lugosi, Gergely Neu

Neural Information Processing Systems 

Despite its widespread use, there is virtually no theoretical understanding about the limitations or the actual benefits of this exploration scheme.