80/20 Rule of Data Science: Hear How Fast, Easy Data Integration Can Break It

At this year's Strata Data Conference in New York City, Syncsort's Paige Roberts sat down with John Myers (@johnlmyers44) of Enterprise Management Associates to discuss what he sees in the evolving Big Data landscape. In this final blog in the three-part interview, we'll discuss the 80/20 rule of data science which points out that most data scientists spend 80% of their time getting data ready for analysis, rather than doing what they do best. In case you missed the earlier parts of our interview… In the first part of the discussion, Myers pointed out a shift away from technology and toward business value and some advantages of in-memory processing for machine learning. In part two, we talked about how to deal with cultural pushback against machine learning applications and how to get machines and people working together to take advantage of the strengths of each. Most of what a scientist has to do is you get the right data together so they can apply to their model, or to manipulate the data that they have.