Mitigating Voter Attribute Bias for Fair Opinion Aggregation