Supplementary Material A Proofs & Derivations 15 A.1 Finite-and Infinite-Horizon Variational Objectives