Bridging the Fairness Gap: Enhancing Pre-trained Models with LLM-Generated Sentences