Give me a hint: Can LLMs take a hint to solve math problems?