FederatedHyperparameterTuning: Challenges, Baselines,andConnectionstoWeight-Sharing

Federated learning (FL)isapopular distributedcomputational setting where training isperformed locally or privately [30, 36] and where hyperparameter tuning has been identified as a critical problem[18].