PAFT: Prompt-Agnostic Fine-Tuning