Scalable and Robust Speculative Decoding