Matrix-Free Least Squares Solvers: Values, Gradients, and What to Do With Them