Effective Skill Unlearning through Intervention and Abstention