Speculative Decoding for Multi-Sample Inference

Open in new window