On the Interplay between Human Label Variation and Model Fairness