Equivariant Representation Learning for Symmetry-Aware Inference with Guarantees