Making Universal Policies Universal