Mathematical Foundation of Interpretable Equivariant Surrogate Models