bethestateattimetandlet F(t) = [ F1(x(t)1;ξ(t)1),, Fn(x(t)n;ξ(t)n) ] > Rn d betheworkergradients attimet. DenoteY(t) andG(t) asthestate(models) andgradients respectively,ofallnodes,fromtimet τmax tot