Optimistic Reinforcement Learning-Based Skill Insertions for Task and Motion Planning