Transformer Memory as a Differentiable Search Index Yi T ay, Vinh Q. Tran

Experiments demonstrate that given appropriate design choices, DSI significantly outperforms strong baselines such as dual encoder models.