Yahoo!'s big, fat clustered Google Machine Learning wedding

Analysis Yahoo! last month married clustered compute to Google's machine learning. The firm's engineers released TensorFlowOnSpark (TFoS), getting the Google Brain Team's machine-learning framework up and running on Spark and Hadoop clusters. Spark is the open-source cluster framework overseen by Apache and employed by Yahoo!, Netflix and others processing petabytes of data across thousands of nodes. TFoS code is available on GitHub under an Apache licence and for use on Amazon's EC2. The idea of TFoS is deep learning on massively clustered systems – and all the benefits of processing and storage that entails – only in a Google-free setting and using an architecture that's "easy" to build and that also delivers fast throughput.