Alignment Helps Make the Most of Multimodal Data