NoMAD-Attention: Efficient LLM Inference on CPUs Through Multiply-add-free Attention

Large Language Model (LLM) inference on Central Processing Units (CPU) is challenging due to the vast quantities of Multiply-Add (MAD) matrix operations in the attention computations.