From Linguistic Giants to Sensory Maestros: A Survey on Cross-Modal Reasoning with Large Language Models