Gradient Flow Through Diagram Expansions: Learning Regimes and Explicit Solutions