A Theory for Conditional Generative Modeling on Multiple Data Sources