Is In-Context Learning Sufficient for Instruction Following in LLMs?