Learning Dexterous Manipulation Skills from Imperfect Simulations