Rule Synergy Analysis using LLMs: State of the Art and Implications

--Large language models (LLMs) have demonstrated strong performance across a variety of domains, including logical reasoning, mathematics, and more. In this paper, we investigate how well LLMs understand and reason about complex rule interactions in dynamic environments, such as card games. We introduce a dataset of card synergies from the game Slay the Spire, where pairs of cards are classified based on their positive, negative, or neutral interactions. Our evaluation shows that while LLMs excel at identifying non-synergistic pairs, they struggle with detecting positive and, particularly, negative synergies. Our findings suggest directions for future research to improve model performance in predicting the effect of rules and their interactions. Large language models (LLMs) have shown promising results in performing a wide range of language and reasoning tasks. Recent benchmarks have demonstrated their abilities in logical reasoning, mathematics, coding, and more.