Even More Guarantees for Variational Inference in the Presence of Symmetries