Averaged Method of Multipliers for Bi-Level Optimization without Lower-Level Strong Convexity