Breaking Data Symmetry is Needed For Generalization in Feature Learning Kernels