TernGrad: Ternary Gradients to Reduce Communication in Distributed Deep Learning
Wei Wen, Cong Xu, Feng Yan, Chunpeng Wu, Yandan Wang, Yiran Chen, Hai Li
–Neural Information Processing Systems
High network communication cost for synchronizing gradients and parameters is the well-known bottleneck of distributed training.
Neural Information Processing Systems
Nov-21-2025, 11:41:24 GMT
- Country:
- Asia > Middle East
- Jordan (0.04)
- Europe > Italy
- Calabria > Catanzaro Province > Catanzaro (0.04)
- North America > United States
- California > Los Angeles County
- Long Beach (0.04)
- Nevada > Washoe County
- Reno (0.04)
- California > Los Angeles County
- Oceania > Australia
- New South Wales > Sydney (0.04)
- Asia > Middle East
- Genre:
- Research Report > New Finding (0.46)
- Technology: