Identifying nonlinear dynamical systems from multi-modal time series data