3e6260b81898beacda3d16db379ed329-Supplemental.pdf

Moreover,we set the initial distributionξ1 tobeuniformoverS. As mentioned in the discussion following Theorem 4.1, it holds thatDVA DFQI. These findings also shed light on the minimax optimality of the OPE problem. PH h=1kvhkΛ 1h, is tighter. Here taking maximum with1 is to deal with the situation wherebVhbVπh+1(,) is close to zero or negative, and the second1 is to account for the variance of the rewards.