A Notation Symbol Meaning D Dataset of the observed trajectories n Total number of observed trajectories in D π Evaluation policy β i Behavior policy for the i th trajectory ρ