Improving Task Diversity in Label Efficient Supervised Finetuning of LLMs