Telescoping Density-Ratio Estimation: Supplementary Material

We did not investigate the use of BN, since many energy-based modelling papers (e.g. Our preliminary experiments suggested that SN was not beneficial for performance. As stated in the main text, the number and (in the case of linear combinations) the spacing of the waymarks are treated as hyperparameters. As illustrated by our sensitivity analysis for MNIST (see Figure 5) it seems that, past a certain point, performance plateaus with the addition of extra waymarks. Table 1 shows the grid-searches we performed for all experiments.