The real big-data problem and why only machine learning can fix it - SiliconANGLE

Why do so many companies still struggle to build a smooth-running pipeline from data to insights? They invest in heavily hyped machine-learning algorithms to analyze data and make business predictions. Then, inevitably, they realize that algorithms aren't magic; if they're fed junk data, their insights won't be stellar. So they employ data scientists that spend 90% of their time washing and folding in a data-cleaning laundromat, leaving just 10% of their time to do the job for which they were hired. What is flawed about this process is that companies only get excited about machine learning for end-of-the-line algorithms; they should apply machine learning just as liberally in the early cleansing stages instead of relying on people to grapple with gargantuan data sets, according to Andy Palmer, co-founder and chief executive officer of Tamr Inc., which helps organizations use machine learning to unify their data silos.