Universal Policies for Software-Defined MDPs