XQuant: Achieving Ultra-Low Bit KV Cache Quantization with Cross-Layer Compression

Open in new window