Integrating Text and Time-Series into (Large) Language Models to Predict Medical Outcomes