Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models

Neural Information Processing Systems 

We derive the distortion-rate function for this setup as a linear program, and provide an efficient algorithm to compute this fundamental limit via the dual of the linear program.

Similar Docs  Excel Report  more

TitleSimilaritySource
None found