Nonparametric Contextual Bandits in Metric Spaces with Unknown Metric

Nirandika Wanigasekara, Christina Yu

Neural Information Processing Systems 

Suppose that there is a large set of arms, yet there is a simple but unknown structure amongst the arm reward functions, e.g.