Optimizing over a Restricted Policy Class in Markov Decision Processes