Unlimiformer: Long-Range Transformers with Unlimited Length Input

Neural Information Processing Systems 

Since the proposal of transformers (V aswani et al., 2017), these models have been limited to bounded input lengths, because of their need to attend to every token in the input.

Similar Docs  Excel Report  more

TitleSimilaritySource
None found