Towards Reversible Model Merging For Low-rank Weights