averaging
Optimal Statistical Rates for Decentralised Non-Parametric Regression with Linear Speed-Up
Dominic Richards, Patrick Rebeschini
Due to the increasingly large size of datasets and high model complexity, direct minimisation of the regularised problem is posing more and morecomputationalchallenges.
Country:
- North America > United States > Massachusetts (0.04)
- North America > Canada > British Columbia > Metro Vancouver Regional District > Vancouver (0.04)
Technology: Information Technology > Artificial Intelligence > Machine Learning > Statistical Learning (0.33)
Local SGD with Periodic Averaging: Tighter Analysis and Adaptive Synchronization
Farzin Haddadpour, Mohammad Mahdi Kamani, Mehrdad Mahdavi, Viveck Cadambe
Neural Information Processing Systems http://nips.cc/
Technology:
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Statistical Learning (0.70)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Optimization (0.67)
Country:
- Europe > Germany > Baden-Württemberg > Stuttgart Region > Stuttgart (0.04)
- North America > United States > Massachusetts > Middlesex County > Cambridge (0.04)
- North America > Canada (0.04)
Technology: Information Technology > Artificial Intelligence > Machine Learning > Statistical Learning > Gradient Descent (0.58)
Communication trade-offs for Local-SGD with large step size
Aymeric Dieuleveut, Kumar Kshitij Patel
Neural Information Processing Systems http://nips.cc/
Country:
- Europe > Switzerland > Vaud > Lausanne (0.04)
- North America > United States > Illinois > Cook County > Chicago (0.04)
- North America > Canada (0.04)
- Europe > France (0.04)
Technology:
Country:
- North America > United States > Virginia (0.04)
- North America > United States > Massachusetts > Middlesex County > Cambridge (0.04)
- Europe > Russia (0.04)
- Asia > Russia (0.04)
Technology: Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.46)
fb2697869f56484404c8ceee2985b01d-Supplemental.pdf
Weshowthat thiscansuccessfully yield "one-shot" knowledge transfer (i.e, without requiring any retraining) between neural networks trained on heterogeneous non-i.i.d.
Country:
- North America > United States (0.04)
- Europe > Switzerland (0.04)
- North America > Canada > British Columbia > Metro Vancouver Regional District > Vancouver (0.04)
- (3 more...)
Technology: Information Technology > Artificial Intelligence > Machine Learning > Neural Networks (1.00)
Country:
- North America > United States > California > San Francisco County > San Francisco (0.14)
- Europe > Switzerland > Zürich > Zürich (0.14)
- North America > Canada (0.04)
- (3 more...)
Technology:
Technology: Information Technology > Artificial Intelligence > Machine Learning > Performance Analysis > Accuracy (1.00)