Exact Aggregation for Federated and Efficient Fine-Tuning of Foundation Models