COSMIC: Data Efficient Instruction-tuning For Speech In-Context Learning