Don't Let Your Robot be Harmful: Responsible Robotic Manipulation