Convergence beyond the over-parameterized regime using Rayleigh quotients