Robust Matrix Sensing in the Semi-Random Model