A Multi-Encoder Frozen-Decoder Approach for Fine-Tuning Large Language Models