AI Study: A managed team labels data with 25% higher quality than crowdsourcing

A study released at the 2019 Open Data Science Conference (ODSC) in Boston demonstrated that managed teams outperformed crowdsourced workers on accuracy and overall cost on a series of the same data labeling tasks. Data science platform developer Hivemind hired a managed workforce and a leading crowdsourcing platform workforce to determine which team delivered higher quality, and at what relative cost. If you're building AI anywhere in your organization, you're in a "race to useable data," according to a 2019 report released by Cognilytica. In its report, the analyst firm specializing in AI, evaluated requirements for data preparation, engineering, and labeling solutions. They found 80 percent of AI project time is spent on aggregating, cleaning, labeling, and augmenting data to be used in machine learning models (ML).