Why you should NOT use MS MARCO to evaluate semantic search - KDnuggets

MS MARCO is a collection of large scale datasets released by Microsoft with the intent of helping the advance of deep learning research related to search. It was our first choice when we decided to create a tutorial showing how to setup a text search application with Vespa. It was getting a lot of attention from the community, in great part due to the intense competition around leaderboards. Besides, being a large and challenging annotated corpus of documents, it checked all the boxes at the time. We followed up the first basic search tutorial with a blog post and a tutorial on how to use ML in Vespa to improve the text search application.