Robust Visual Servoing under Human Supervision for Assembly Tasks