LLMs cannot spot math errors, even when allowed to peek into the solution