ScaleLLM: A Resource-Frugal LLM Serving Framework by Optimizing End-to-End Efficiency

Open in new window