A Tale of Two Symmetries: Exploring the Loss Landscape of Equivariant Models