MinibatchvsLocalSGDfor HeterogeneousDistributedLearning

Given the massive scale of many modern machine learning models and datasets, it has become important to develop better methods for distributed training.