The Role of Visual Modality in Multimodal Mathematical Reasoning: Challenges and Insights