Learning to Transfer Human Hand Skills for Robot Manipulations