Fair Multiple Decision Making Through Soft Interventions