End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answering

Previous work considers two potential solutions (see Table 1 for a high-level summary). First, they adopt a stage-wise training, where the retriever is trained while freezing the reader and vice versa ( Karpukhin et al., 2020, Izacard and Grave, 2021b, a).