FedRef: Communication-Efficient Bayesian Fine-Tuning using a Reference Model