Stop Walking in Circles! Bailing Out Early in Projected Gradient Descent