HeadInfer: Memory-Efficient LLM Inference by Head-wise Offloading

Open in new window