Group Fairness by Probabilistic Modeling with Latent Fair Decisions