Distilling LLMs' Decomposition Abilities into Compact Language Models