Robust Visual Sim-to-Real Transfer for Robotic Manipulation