Quantile Bandits for Best Arms Identification
Zhang, Mengyan, Ong, Cheng Soon
–arXiv.org Artificial Intelligence
We consider a variant of the best arm identification task in stochastic multi-armed bandits. Motivated by risk-averse decision-making problems, our goal is to identify a set of $m$ arms with the highest $\tau$-quantile values within a fixed budget. We prove asymmetric two-sided concentration inequalities for order statistics and quantiles of random variables that have non-decreasing hazard rate, which may be of independent interest. With these inequalities, we analyse a quantile version of Successive Accepts and Rejects (Q-SAR). We derive an upper bound for the probability of arm misidentification, the first justification of a quantile based algorithm for fixed budget multiple best arms identification. We show illustrative experiments for best arm identification.
arXiv.org Artificial Intelligence
Feb-21-2023
- Country:
- North America > United States
- Georgia > Fulton County > Atlanta (0.04)
- Europe
- Ukraine (0.04)
- Spain > Canary Islands (0.04)
- United Kingdom > England
- Oxfordshire > Oxford (0.04)
- Cambridgeshire > Cambridge (0.04)
- Sweden > Stockholm
- Stockholm (0.04)
- France
- Occitanie > Haute-Garonne
- Toulouse (0.04)
- Hauts-de-France > Nord
- Lille (0.04)
- Occitanie > Haute-Garonne
- Asia
- Myanmar > Tanintharyi Region
- Dawei (0.04)
- Middle East > Israel
- Haifa District > Haifa (0.04)
- China > Beijing
- Beijing (0.04)
- Myanmar > Tanintharyi Region
- North America > United States
- Genre:
- Research Report (0.82)
- Industry:
- Technology: