Enhancing Dexterity in Robotic Manipulation via Hierarchical Contact Exploration