FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Models Rui Ye1 Rui Ge

Based on FedLLM-Bench, we conduct experiments on all datasets to benchmark existing FL methods and provide empirical insights (e.g., multilingual collaboration). We believe that our FedLLM-Bench can benefit the FedLLM community by reducing required efforts, providing a practical testbed, and promoting fair comparisons.