On the Importance of Clinical Notes in Multi-modal Learning for EHR Data