Leveraging Robust Optimization for LLM Alignment under Distribution Shifts