Best-Arm Identification in Linear Bandits

Marta Soare, Alessandro Lazaric, Remi Munos

Neural Information Processing Systems 

We characterize the complexity of the problem and introduce sample allocation strategies that pull arms to identify the best arm with a fixed confidence, while minimizing the sample budget. In particular, we show the importance of exploiting the global linear structure to improve the estimate of the reward of near-optimal arms. We analyze the proposed strategies and compare their empirical performance. Finally, as a by-product of our analysis, we point out the connection to the G-optimality criterion used in optimal experimental design.

Similar Docs  Excel Report  more

TitleSimilaritySource
None found