Supplementary materials for " Federated Expectation Maximization with heterogeneity mitigation and variance reduction "