How Intermodal Interaction Affects the Performance of Deep Multimodal Fusion for Mixed-Type Time Series