Enhancing Asynchronous Time Series Forecasting with Contrastive Relational Inference