A Solution to Time-Varying Markov Decision Processes