TelescopingDensity-RatioEstimation: SupplementaryMaterial

Dashed boxes denote layers that are not always present. For the MNIST energy-based modelling experiments, we use average pooling operations since other work [19, 4] has found this to produce higher quality samples than max pooling. We note that that another commonly used feature in recent GAN and EBM architectures is Spectral Normalisation (SN) [13]. Our preliminary experiments suggested that SN was not beneficial for performance. As stated in the main text, the number and (in the case of linear combinations) the spacing of the waymarks aretreated ashyperparameters.