Ubiquitous Symmetry at Critical Points Across Diverse Optimization Landscapes