What's the Plan? Evaluating and Developing Planning-Aware Techniques for Language Models