SentenceKV: Efficient LLM Inference via Sentence-Level Semantic KV Caching

Open in new window