Generating Full-field Evolution of Physical Dynamics from Irregular Sparse Observations