Online Learning with a Hint
Dekel, Ofer, flajolet, arthur, Haghtalab, Nika, Jaillet, Patrick
–Neural Information Processing Systems
We study a variant of online linear optimization where the player receives a hint about the loss function at the beginning of each round. The hint is given in the form of a vector that is weakly correlated with the loss vector on that round. We show that the player can benefit from such a hint if the set of feasible actions is sufficiently round. Specifically, if the set is strongly convex, the hint can be used to guarantee a regret of O(log(T)), and if the set is q-uniformly convex for q\in(2,3), the hint can be used to guarantee a regret of o(sqrt{T}). In contrast, we establish Omega(sqrt{T}) lower bounds on regret when the set of feasible actions is a polyhedron.
Neural Information Processing Systems
Dec-31-2017
- Country:
- North America > United States > Massachusetts (0.14)
- Industry:
- Education > Educational Setting > Online (0.41)