Instruction-following Evaluation through Verbalizer Manipulation