Data Management - The Key to a Successful AI Project - HPCwire

While neural networks seem to get all the glory, data is the unsung hero of AI projects – data lies at the heart of everything from model training to tuning to selection to validation. No matter how compelling the business case, or talented the team, without high-quality data, AI projects are doomed to fail. An example from the field of computer vision illustrates the challenge. While we marvel at the accuracy of image classification models such as vgg16 and ResNet[2], we may take it for granted that a database with over 14,000,000 hand-annotated images exists to train these models. These are hardly random images – rather, they are organized based on a similarly expansive effort called WordNet, an effort to build a lexical database for the English language started in 1985[3].