Reward Distance Comparisons Under Transition Sparsity