Multimodal Flare Forecasting with Deep Learning