MoshpitSGD: Communication-Efficient DecentralizedTraining onHeterogeneousUnreliableDevices

Neural Information Processing Systems 

We demonstrate the efficiency of our protocol for distributed optimization with strongtheoreticalguarantees.