Variance Reduced ProxSkip: Algorithm, Theory and Application to Federated Learning

Looking back at the progress of the field, we identify 5 generations of LT methods: 1) heuristic, 2) homogeneous, 3) sublinear, 4) linear, and 5) accelerated.