Appendix A for AdaOPS

According to Alg. 2, in each exploration, at least one leaf node will be expanded. Thus, we have the conclusion that AdaOPS is guaranteed to terminate. First, we will demonstrate that the value of any belief can be formulated as an integral. This lemma is a concentration inequality of self-normalized importance sampling estimator. The ESS threshold µ for adaptive resampling is set to .