Instruction Following without Instruction Tuning