Goto

Collaborating Authors

 Large Language Model





Learning Multimodal LLMs without Text-only Forgetting

Neural Information Processing Systems

The LoRRA mirrors the structure of attention but utilizes low-rank connections to ensure efficiency. Initially, image and text inputs are aligned with visual learners operating alongside the main attention, balancing focus on visual elements.