Gradual Domain Adaptation via Normalizing Flows

In a standard problem of learning predictive models, it is assumed that the probability distributions of the test data and the training data are the same. The prediction performance generally deteriorates when this assumption does not hold. The simplest solution is to discard the training data and collect new samples from the distribution of the test data. However, this solution is inefficient and sometimes impossible, and there is a strong demand for utilizing the valuable labeled data in the source domain. Domain adaptation (Ben-David et al., 2007) is one of the transfer learning frameworks in which the probability distributions of the prediction target data and the training data are different. In domain adaptation, the source domain is a distribution with many labeled samples, and the target domain is a distribution with a few or no labeled samples. The case with no labels from the target domain is called unsupervised domain adaptation and has been the subject of much research, including theoretical analysis and real-world application (Ben-David et al., 2007; Cortes et al., 2010; Mansour et al., 2009; Redko et al., 2019; Zhao et al., 2019). In domain adaptation, the predictive performance on the target data deteriorates when the discrepancy between the source and target domains is large.