Bridging the Human to Robot Dexterity Gap through Object-Oriented Rewards