the paper thoroughly and incorporate all the comments

Neural Information Processing Systems 

We thank all three reviewers for their careful readings, valuable questions and constructive suggestions. Thanks for raising the questions on infinite arms and frequentist regret bound for DTS. Thanks for raising this point and we will add a remark on it. We will add a remark on this point in the revision. We will add a remark on this point in the revision.