Federated Learning for Feature Generalization with Convex Constraints

Federated learning (FL) often struggles with generalization due to heterogeneous client data. Local models are prone to overfitting their local data distributions, and even transferable features can be distorted during aggregation. To address these challenges, we propose FedCONST, an approach that adaptively modulates update magnitudes based on the global model's parameter strength. This prevents over-emphasizing welllearned parameters while reinforcing underdeveloped ones. Specifically, FedCONST employs linear convex constraints to ensure training stabil-Figure 1. Illustration of the parameter space in FL. (1) Vanilla ity and preserve locally learned generalization FL drives the optimization process away from the generalization capabilities during aggregation.