Fairness Auditing with Multi-Agent Collaboration

de Vos, Martijn, Dhasade, Akash, Bourrée, Jade Garcia, Kermarrec, Anne-Marie, Merrer, Erwan Le, Rottembourg, Benoit, Tredan, Gilles

arXiv.org Artificial Intelligence 

For instance, (Rastegarpanah Existing work in fairness audits assumes that et al., 2021) proposes to study the illegal use of some profile agents operate independently. In this paper, we data in the response of a model in such a query-response consider the case of multiple agents auditing the setup. Yet, as of today, an auditor performs her audit tasks same platform for different tasks. Agents have on each attribute of interest sequentially, one after the other, two levers: their collaboration strategy, with or and independent of other auditors. For example, when she without coordination beforehand, and their sampling wants to audit an ML model that predicts whether it is safe method. We theoretically study their interplay to issue a loan (Feldman et al., 2015), she begins by auditing when agents operate independently or collaborate.