Teaching LLMs to Think Mathematically: A Critical Study of Decision-Making via Optimization