IBM's Breakthrough Distributed Computation for Deep Learning Workloads

Then the requirements change; much more data needs to be added to the process to get the project done in a reasonable span of time. Logic says that all you need to do is add more horsepower to do the job. As Dana Carvey used to say in his comedy act when satirizing President George H.W. Bush: "Not gonna do it." That's right: Until today, adding more servers would not have solved the problem. Deep-learning analytics systems up to now have only been able to run on a single server; use cases simply haven't been scalable by adding more servers, and there are major backend reasons for that.