Guiding Through Complexity: What Makes Good Supervision for Hard Reasoning Tasks?