Towards Tight Communication Lower Bounds for Distributed Optimisation

This setting models data-parallel optimisation, and covers virtually all practical settings, from large-scale regression, to the training of deep neural networks.