University of Southern California Information Sciences Institute
Quantifying the Impact of Cognitive Biases in Question-Answering Systems
Burghardt, Keith (University of California, Davis) | Hogg, Tad (Institute for Molecular Manufacturing) | Lerman, Kristina (University of Southern California Information Sciences Institute)
Crowdsourcing can identify high-quality solutions to problems; however, individual decisions are constrained by cognitive biases. We investigate some of these biases in an experimental model of a question-answering system. We observe a strong position bias in favor of answers appearing earlier in a list of choices. This effect is enhanced by three cognitive factors: the attention an answer receives, its perceived popularity, and cognitive load, measured by the number of choices a user has to process. While separately weak, these effects synergistically amplify position bias and decouple user choices of best answers from their intrinsic quality. We end our paper by discussing the novel ways we can apply these findings to substantially improve how high-quality answers are found in question-answering systems.
Exploiting Semantics for Big Data Integration
Knoblock, Craig A. (University of Southern California Information Sciences Institute) | Szekely, Pedro (University of Southern California Information Sciences Institute)
There is a great deal of interest in big data, focusing mostly on data set size. The use of semantics in this integration descriptions and then integrating the data within process is key to building an approach that scales this unified framework. Finally, we conclude by to large numbers of heterogeneous sources. For example, in and (4) integrate the data across sources using this our museum use case, we received data in spreadsheets model. Karma has been used on a variety of types of (figure 1), comma-separated values (CSV), data, including biological data, mobile phone data, JSON (figure 3), XML, and relational databases (figure geospatial data, and cultural heritage data.