KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache

Open in new window