Jointly Modeling Inter- & Intra-Modality Dependencies for Multi-modal Learning

We view the multi-modal learning problem from the lens of generative models where we consider the target as a source of multiple modalities and the interaction between them. Towards that end, we propose inter- & intra-modality modeling (I2M2) framework, which captures and integrates both the inter-and intra-modality dependencies, leading to more accurate predictions.