Goto

Collaborating Authors

 rethinking search engine


Rethinking Search Engines and Recommendation Systems

Communications of the ACM

In her popular book, Weapons of Math Destruction, data scientist Cathy O'Neil elegantly describes to the general population the danger of the data science revolution in decision making. She describes how the US News ranking of universities, which orders universities based on 15 measured properties, created new dynamics in university behavior, as they adapted to these measures, ultimately resulting in decreased social welfare. Unfortunately, the idea that data science-related algorithms, such as ranking, cause changes in behavior, and that this dynamic may lead to socially inferior outcomes, is dominant in our new online economy. Ranking also plays a crucial role in search engines and recommendation systems--two prominent data science applications that we focus on in this article. Recommendation systems endorse items by ranking them using information induced from some context--for example, the Web page a user is currently browsing, a specific application the user is running on her mobile phone, or the time of day.