Human Computation Game for Commonsense Data Verification

Games With A Purpose (or GWAP) provide an interesting way to collect data from web users. With over a million sentences collected and growing steadily, data verification becomes increasingly important. This research explores the alternative of designing human computation games specifically for verification purposes. Two games, Top10 and Pirate and Ghost, are designed for commonsense data verification. Top10 is a single-player game, in which the player attempts to guess the top answers to a given question. We use the frequency data to verify if the assertion is truly common. Pirate and Ghost is a multiplayer guessing role playing game in a network of concepts from the CSKB. We use the game data to identify the relation between two concepts. This paper presents the design of both games, and evaluate the efficiency and precision of each with two experiments. The results show that the two games can be coupled to achiever higher efficiency and precision in the data verification process.