FedRolex: Model-Heterogeneous Federated Learning with Rolling Sub-Model Extraction

Neural Information Processing Systems 

Federated Dropout) and reduces the gap between model-heterogeneous and model-homogeneous FL, especially under the large-model large-dataset regime.