Fine-tuning Language Models over Slow Networks using Activation Quantization with Guarantees Jue Wang

Communication compression is a crucial technique for modern distributed learning systems to alleviate their communication bottlenecks over slower networks.