On the Variational Costs of Changing Our Minds