Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity
–Neural Information Processing Systems
We consider nonconvex stochastic optimization problems in the asynchronous centralized distributed setup where the communication times from workers to a server can not be ignored, and the computation and communication times are potentially different for all workers.
Neural Information Processing Systems
Feb-18-2026, 22:30:42 GMT
- Country:
- Europe
- Italy (0.04)
- Russia > Central Federal District
- Moscow Oblast > Moscow (0.04)
- Asia
- Russia (0.04)
- Middle East > Saudi Arabia
- Mecca Province > Thuwal (0.04)
- Europe
- Genre:
- Research Report > Experimental Study (1.00)
- Technology: