Federated Submodel Optimization for Hot and Cold Data Features Y ucheng Ding

The global model for federated optimization typically contains a large and sparse embedding layer, while each client's local data tend to interact with part of features, updating only a small submodel with the feature-related embedding vectors.