RNNs are not Transformers (Yet): The Key Bottleneck on In-context Retrieval

Open in new window