Decentralized Low-Rank Fine-Tuning of Large Language Models