UnderstandingEnd-to-EndModel-Based ReinforcementLearningMethodsasImplicit Parameterization

While knowntobesample efficient, these methods havefailed tofully leverage recent advances indeep learning, forcing the use of less efficient but more scalable model-free methods which try to learn the values directly.