CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for T ask-A ware Parameter-Efficient Fine-tuning Yibo Y ang

Current parameter-efficient fine-tuning (PEFT) methods build adapters widely agnostic of the context of downstream task to learn, or the context of important knowledge to maintain.