SPLADE-v3: New baselines for SPLADE
Lassance, Carlos, Déjean, Hervé, Formal, Thibault, Clinchant, Stéphane
–arXiv.org Artificial Intelligence
A companion to the release of the latest version of the SPLADE library. We describe changes to the training structure and present our latest series of models -- SPLADE-v3. We compare this new version to BM25, SPLADE++, as well as re-rankers, and showcase its effectiveness via a meta-analysis over more than 40 query sets. SPLADE-v3 further pushes the limit of SPLADE models: it is statistically significantly more effective than both BM25 and SPLADE++, while comparing well to cross-encoder re-rankers. Specifically, it gets more than 40 MRR@10 on the MS MARCO dev set, and improves by 2% the out-of-domain results on the BEIR benchmark.
arXiv.org Artificial Intelligence
Mar-11-2024
- Country:
- South America > Colombia
- Meta Department > Villavicencio (0.04)
- North America > United States
- Washington > King County
- Seattle (0.04)
- New York > New York County
- New York City (0.04)
- Washington > King County
- Europe > Ireland
- Leinster > County Dublin > Dublin (0.04)
- South America > Colombia
- Genre:
- Research Report (0.87)
- Technology: