TernGrad: Ternary Gradients to Reduce Communication in Distributed Deep Learning
Wei Wen, Cong Xu, Feng Yan, Chunpeng Wu, Yandan Wang, Yiran Chen, Hai Li
–Neural Information Processing Systems
High network communication cost for synchronizing gradients and parameters is the well-known bottleneck of distributed training.
Neural Information Processing Systems
Nov-21-2025, 11:41:24 GMT
- Country:
- Oceania > Australia
- New South Wales > Sydney (0.04)
- North America > United States
- Nevada > Washoe County
- Reno (0.04)
- California > Los Angeles County
- Long Beach (0.04)
- Nevada > Washoe County
- Europe > Italy
- Calabria > Catanzaro Province > Catanzaro (0.04)
- Asia > Middle East
- Jordan (0.04)
- Oceania > Australia
- Genre:
- Research Report > New Finding (0.46)
- Technology: