SpecPipe: Accelerating Pipeline Parallelism-based LLM Inference with Speculative Decoding

Open in new window