Using Large Ensembles of Control Variates for Variational Inference

V ariational inference is increasingly being addressed with stochastic optimization. In this setting, the gradient's variance plays a crucial role in the optimization procedure, since high variance gradients lead to poor convergence.