Learn to Combine Modalities in Multimodal Deep Learning