Prospective Side Information for Latent MDPs