Simplicity Bias Leads to Amplified Performance Disparities