Refusal in LLMs is an Affine Function