Parameter-Efficient Fine-Tuning with Circulant and Diagonal Vectors