SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models

Open in new window