Appendix ATheoretical Derivation of P-VAE

For both GP-VAE and CP-VAE, the number of attention heads is empirically set to 4. We customize a fixed weight 0.2 to the KL divergence such that we can bias more towards the reconstruction loss in Eq. (5) and Eq.