Fast Approximate Dynamic Programming for Infinite-Horizon Markov Decision Processes