Modeling Irregular Astronomical Time Series with Neural Stochastic Delay Differential Equations