Latent State Marginalization as a Low-cost Approach for Improving Exploration