Uncovering the Strategic Reasoning Limitations of LLMs via Game-Theoretic Evaluations

Neural Information Processing Systems 

As Large Language Models (LLMs) are integrated into critical real-world applications, their strategic and logical reasoning abilities are increasingly crucial. This paper evaluates LLMs' reasoning abilities in competitive environments through game-theoretic tasks, e.g., board and card games that require pure logic and strategic reasoning to compete with opponents.