The Planner Optimization Problem: Formulations and Frameworks