Minimal model of permutation symmetry in unsupervised learning