An Efficient Inference Framework for Early-exit Large Language Models

Open in new window