On the Interplay between Human Label Variation and Model Fairness

Kurniawan, Kemal, Mistica, Meladel, Baldwin, Timothy, Lau, Jey Han

arXiv.org Artificial Intelligence 

The impact of human label variation (HLV) on model fairness is an unexplored topic. This paper examines the interplay by comparing training on majority-vote labels with a range of HLV methods. Our experiments show that without explicit debiasing, HLV training methods have a positive impact on fairness.