MoS: Unleashing Parameter Efficiency of Low-Rank Adaptation with Mixture of Shards

Open in new window