94cb02feb750f20bad8a85dfe7e18d11-AuthorFeedback.pdf

The contributions of CSER put it beyond merely a "tweak". Our GRBS compressor (Section 3.3) reduces We will revise the claim by adding context. "is it using NCCL " All the algorithms use the same communication library: Horovod with NCCL. "How is the experimental setup chosen" In this work, we aim to show that we can significantly reduce the heavy inter-node communication. Applying error reset to ADAM is future work.