Automatic Differentiation of Programs with Discrete Randomness

In this paper we develop a new reparameterization-based methodology that allows for generating programs whose expectation is the derivative of the expectation of the original program.