On Optimal Caching and Model Multiplexing for Large Model Inference
–Neural Information Processing Systems
By combining a caching algorithm, namely Greedy Dual Size with Frequency (GDSF) or Least Expected Cost (LEC), with a model multiplexer, we achieve optimal rates in both offline and online settings.
Neural Information Processing Systems
Feb-16-2026, 18:25:18 GMT
- Country:
- Asia > Middle East
- Jordan (0.14)
- North America > United States
- California > Santa Clara County > Palo Alto (0.04)
- Asia > Middle East
- Technology: