LLMs with improved chemical reasoning capabilities in the other two sub-tasks.

Causal language modeling using the Transformer architecture has yielded remarkable capabilities in Large Language Models (LLMs) over the last few years.

Aiming to address this limitation, we present Easy2Hard-Bench, a consistently formatted collection of 6 benchmark datasets spanning various domains, such as mathematics and programming problems, chess puzzles, and reasoning questions.

Understanding and reasoning about physics is a hallmark of intelligence [9].

Solving complex planning problems has been a long-standing challenge in computer science.