Unsupervised Representation Learning from Pre-trained Diffusion Probabilistic Models Appendix A Algorithm

Algorithm 1 shows the training procedure of PDAE. Table 1 shows the network architecture of pre-trained DPMs we use. Table 2 shows the network architecture. The sampled z will be denormalized for use. We use EMA on all model parameters with a decay factor of 0.9999.