The continuous Bernoulli: fixing a pervasive error in variational autoencoders

Here we show that, far from being a triviality or nuisance that is convenient to ignore, this error has profound importance to V AE, both qualitative and quantitative.