Efficient Pure Exploration in Adaptive Round model
Jin, Tianyuan, SHI, Jieming, Xiao, Xiaokui, Chen, Enhong
–Neural Information Processing Systems
In the adaptive setting, many multi-armed bandit applications allow the learner to adaptively draw samples and adjust sampling strategy in rounds. In many real applications, not only the query complexity but also the round complexity need to be optimized. In this paper, we study both PAC and exact top-$k$ arm identification problems and design efficient algorithms considering both round complexity and query complexity. For PAC problem, we achieve optimal query complexity and use only $O(\log_{\frac{k}{\delta}} *(n))$ rounds, which matches the lower bound of round complexity, while most of existing works need $\Theta(\log \frac{n}{k})$ rounds. For exact top-$k$ arm identification, we improve the round complexity factor from $\log n$ to $\log_{\frac{1}{\delta}} *(n)$, and achieve near optimal query complexity.
Neural Information Processing Systems
Mar-18-2020, 23:16:14 GMT
- Technology: