Appendix

The appendix is organized as follows. While this is where one uses domain expertise, this could be hard to estimate in certain real world problems. Our methods can be used for various applications such as drug discovery, advertising, and recommendation systems. Using a variant of Azuma's inequality [47, 51], for any κ > 0 the following inequality holds, P null |nulle I (.,G) indicates the minimum influence factor for arms. Using Lemma I.5, we have the following bound on [V A modified version of the Definition (4.3) of competitive set and non-competitive set is as follows: Definition E.1.