First Heuristic Then Rational: Dynamic Use of Heuristics in Language Model Reasoning