LaMDA: Large Model Fine-Tuning via Spectrally Decomposed Low-Dimensional Adaptation