Frequentist Guarantees of Distributed (Non)-Bayesian Inference