SupplementaryMaterialsfor" POLY-HOOT: Monte-CarloPlanning inContinuousSpaceMDPswithNon-AsymptoticAnalysis " AAlgorithmDetails