A/B/nTestingwithControlinthePresenceof Subpopulations

Thisstrategy is shown to be asymptotically optimal in the following sense: ifτδ is the first time when the strategy ensures that it is able to output the correct answer with probability at least1 δ, then E[τδ] grows linearly withlog(1/δ) at the exact optimal rate.