Towards Adaptive Prefix Tuning for Parameter-Efficient Language Model Fine-tuning