Fairness-Accuracy Trade-Offs: A Causal Perspective