Despite significant interest in developing general purpose fact checking models, it is challenging to construct a large-scale fact verification dataset with realistic claims that would occur in the real world. Existing claims are either authored by crowdworkers, thereby introducing subtle biases that are difficult to control for, or manually verified by professional fact checkers, causing them to be expensive and limited in scale. In this paper, we construct a challenging, realistic, and large-scale fact verification dataset called FaVIQ, using information-seeking questions posed by real users who do not know how to answer. The ambiguity in information-seeking questions enables automatically constructing true and false claims that reflect confusions arisen from users (e.g., the year of the movie being filmed vs. being released). Our claims are verified to be natural, contain little lexical bias, and require a complete understanding of the evidence for verification. Our experiments show that the state-of-the-art models are far from solving our new task. Moreover, training on our data helps in professional fact-checking, outperforming models trained on the most widely used dataset FEVER or in-domain data by up to 17% absolute. Altogether, our data will serve as a challenging benchmark for natural language understanding and support future progress in professional fact checking.

By M. Marin OTC:VQSLF TSX:VQS READ THE FULL VQSLF RESEARCH REPORT VIQ Solutions (VQSLF) (VQS.V) operates a secure technology platform that offers artificial intelligence (AI) enabled video capture software and audio recording with voice-to-text capabilities. Speech recognition is an underlying foundation of the VIQ AI-enabled transcription platform. The company is focused on highly compliant, security-focused and regulated markets. VIQ, customers can obtain higher volume per worker and lower unitary cost and production time, according to management. Affordable devices that enable the collection of significant volumes of audio and video information are expected to drive new opportunities for VIQ.