Supplementary 1 Outline The following is the outline of this supplementary material: In appendix A, we present our upper-bound experiments which complements the experiments

In Figure 1, we show a t-SNE plot of the distributions in four datasets used in this work. In Table 1 and Table 2 of this supplementary material, we present our upper-bound results that complement the experiments shown in Table 2 and Table 3 of the main manuscript. In addition, our proposed method still outperforms other baselines, for both settings (i.e., Setting 1 and 2 described in Sec 4.2 in our main manuscript), which demonstrates the efficacy of our For more implementation details, please refer to [4].