6fb9ea5197c0b8ece8a64220fb82cdfe-Paper-Conference.pdf

Neural Information Processing Systems 

In the case of biased and contractive compressors (e.g., top-k), theEF21 algorithm of Richtárik et al. (2021), which instead implements an error-feedback mechanism, is the current state of the art. These two classes of compression schemes and algorithms are distinct, with different analyses and proof techniques.