Posterior distributions depend on the modeling assumptions and can rarely be computed exactly. V ariational Inference (VI) is a technique to approximate posterior distributions through optimization. It involves choosing a set of tractable densities, a.k.a.
Sketching and stochastic gradient methods are arguably the most common techniques to derive efficient large scale learning algorithms. In this paper, we investigate their application in the context of nonparametric statistical learning.
In our output perturbation method, the parties combine local models within a secure computation and then add the required differential privacy noise before revealing the model.