Distributionally Robust Federated Learning with Client Drift Minimization