Review for NeurIPS paper: Choice Bandits
–Neural Information Processing Systems
Summary and Contributions: The paper deals with a variant of the dueling or battling bandit problem, where it is allowed to pull up to k many arms in each time step. In addition, a more general class of multiwise comparison models is considered as the ones investigated in the battling bandit problem or the previously used Multinomial Logit model of related settings. A lower bound on the expected regret is shown for the general class of multiwise comparison models, which in particular gives a more refined bound as the previously shown for the case of MNL models. Moreover, one learning algorithm is suggested for the considered problem and analyzed theoretically with respect to its expected regret bound. Finally, the proposed algorithm is investigated in numerous experiments on synthetic as well as real-world datasets and compared to related algorithms. Post Rebuttal After reading the other reviews as well as the author's response, I think that the authors have not addressed two of the concerns mentioned in the reviews thoroughly enough, namely the independence of k for the complexity terms as well as the suggestion to compare with the lower bounds coming from the structured bandits.
Neural Information Processing Systems
Feb-6-2025, 18:19:02 GMT
- Technology: