CALF: Aligning LLMs for Time Series Forecasting via Cross-modal Fine-Tuning