Mitigating Bias in Federated Learning

As machine learning (ML) has been applied to facilitate decision-making in various areas, such as hiring, loan grading etc., there have been and continue to be increasing concerns [3, 31] that ML models will inevitably "learn undesired bias" from the training data and make unfair predictions. From algorithms erroneously detecting suspects of crimes base on the color of their skin [7] and deciding who goes to jail [26], to algorithms used to predict test scores that provide unfairly higher scores to socioeconomically privileged students, allowing them to enter universities at a higher rate [27], the lack of understanding and control of undesired bias in ML models has tangible consequences. To deal with this challenge of biased models, many researchers have devoted their efforts, e.g., [15, 17, 35, 8, 2] to define, detect and mitigate bias in ML over the past decade. These approaches mainly measure and reduce undesired bias with respect to a sensitive attribute, such as age or race, in the training dataset. Although many of them provide various effective approaches, they all focus on centralized ML, where the training dataset is stored in a single place, executing the learning procedure, and hence assume full access to the entire dataset.