Orthogonal Statistical Inference for Multimodal Data Analysis