On the detrimental effect of invariances in the likelihood for variational inference Richard Kurle A WS AI Labs

We proceed by first considering translation invariances in a linear model with a single data point in detail. We show that, while the true posterior can be constructed from a mean-field parametrisation, this is achieved only if the objective function takes into account the invariance gap.