Variational Transfer Learning using Cross-Domain Latent Modulation