ADAPT to Robustify Prompt Tuning Vision Transformers