Robust Safe Control with Multi-Modal Uncertainty