exploration strategy with PAC guarantees (R-MAX, MBIE, etc.) can still be far from optimal in terms of exploration

Jan-23-2025, 10:44:19 GMT–Neural Information Processing Systems 

This is a clear example of exploration-then-exploitation behaviour with exactly one phase change in the process.