A Experiments Supplement

Here we test the sensitivity of model w.r.t. the hyperparameter Figure 1 shows the change of fairness (equalized odds) under different cutoff value. We show the effect of validation size on accuracy and equalized odds in Fig. . Figure 4: Change of accuracy as validation size varies. For ease of exposition, here we consider binary classification (i.e., Figure 5: Change of equalized odds as validation size varies. In Section A.1 above, we showed the sensitivity of model performance and fairness