Cheaply Estimating Inference Efficiency Metrics for Autoregressive Transformer Models Keshav Santhanam Peter Henderson NVIDIA Stanford University

Open in new window