Dynamic Skill Adaptation for Large Language Models