A Time-Inhomogeneous Markov Model for Resource Availability under Sparse Observations