Can LLMs subtract numbers?

Jobanputra, Mayank, Walter, Nils Philipp, Mehta, Maitrey, Veseli, Blerta, Chapple, Evan Parker Kelly, Wang, Yifan, Chetani, Sneha, Pavlick, Ellie, Vergari, Antonio, Demberg, Vera

arXiv.org Artificial Intelligence 

We present a systematic study of subtraction in large language models (LLMs). While prior benchmarks emphasize addition and multiplication, subtraction has received comparatively little attention despite being structurally distinct as a non-commutative operation. We evaluate eight pretrained LLMs spanning four families on addition and subtraction problems. Our experiments reveal that subtraction accuracy lags behind addition by a wide margin. We find that the errors for ($a-b$) are concentrated in cases where ($a