Vidur: A Large-Scale Simulation Framework For LLM Inference

Open in new window