Finding All-Good Arms in Stochastic Bandits

As an example, we consider the New Y orker Cartoon Caption Contest (NYCCC) . Each week, contestants submit thousands of supposedly funny captions for a cartoon (see Appendix A), which are rated from 1 (unfunny) to 3 (funny) through a crowdsourcing process.