Goto

Collaborating Authors

 lrmf


8 SupplementaryMaterial

Neural Information Processing Systems

For the GLOW experiment we stacked three GLOW transformations at different scales eachwitheightaffinecoupling blocks spaced byactnorms andpermutations each parameterized byaCNN with twohidden layers with 512 filters each. In a recent arXiv submission, Arjovsky et al.[2] suggested that in the presence of an observable variability intheenvironmente(e.g. While this procedure workedondistributions that were very similar tobegin with, inthe majority of cases the log-likelihood fit toB did not provide informative gradients when evaluated on the transformed dataset, as the KL-divergence between distributions with disjoint supports is infinite. The code is available in lrmf_gradient_simulation.ipynb. LRMF objective(Eq 2) decreases over time and reaches zero when two datasets are aligned.




CooperativeDistributionAlignment viaJSDUpperBound

Neural Information Processing Systems

Unsupervised distribution alignment estimates a transformation that maps two or more source distributions to ashared aligned distribution given only samples from each distribution. This task has many applications including generative modeling, unsupervised domain adaptation, and socially aware learning.




Cooperative Distribution Alignment via JSD Upper Bound Wonwoong Cho Purdue University

Neural Information Processing Systems

Unsupervised distribution alignment estimates a transformation that maps two or more source distributions to a shared aligned distribution given only samples from each distribution. This task has many applications including generative modeling, unsupervised domain adaptation, and socially aware learning. Most prior works use adversarial learning (i.e., min-max optimization), which can be


8 Supplementary Material

Neural Information Processing Systems

Attached IPython notebooks were tested to work as expected in Colab. On replacing the Gaussian prior with a learned density in normalizing flows. As mentioned in the main paper, FFJORD LRMF performed on par with Real NVP version. The dynamics can be found in the Figure 10. Rightmost column shows LRMF convergence.