Efficient deep data assimilation with sparse observations and time-varying sensors