A Sharp Universality Dichotomy for the Free Energy of Spherical Spin Glasses