RRRA: Resampling and Reranking through a Retriever Adapter