Efficient Resources Allocation for Markov Decision Processes