One Goal, Many Challenges: Robust Preference Optimization Amid Content-Aware and Multi-Source Noise