Doing Right by Not Doing Wrong in Human-Robot Collaboration