Navigating Fairness Measures and Trade-Offs

One of the main risks accompanying the use of artificial intelligence in decision making is that the algorithms that are used are biased, and as a result can lead to unfair outcomes (Pessach and Shmueli, 2020). In particular, artificial intelligence is prone to (unintentionally) indirectly discriminate against certain groups. Machine learning systems (a type of AI) are fitted to data and find patterns in that data in order to predict a target variable. In doing so, they often use correlations present in the data (e.g. between ethnicity and zip codes, as with segregated neighbourhoods the zip code is a good predictor for ethnicity) to select on a problematic property (ethnicity) not directly but through the use of information on an unproblematic property (zip codes). This means that often these systems do not have direct access to variables that would be unfair to select on, but they still produce outputs that would lead to unfair treatment of certain groups. Put more precisely, indirect discrimination is the situation where a group A (e.g.