Characterizing Stereotypical Bias from Privacy-preserving Pre-Training