V eLoRA: Memory Efficient Training using Rank-1 Sub-Token Projections Roy Miles

Despite their success, training and fine-tuning these models is still far too computationally and memory intensive.