Intel open sources deep learning with BigDL for Apache Spark

It will allow developers to write deep learning applications as standard Spark programmes that run on top of existing Spark or Hadoop clusters. Intel has launched a deep learning library – the open-source BigDL for Apache Spark cluster-computing framework. BigDL, which is already running in the Databricks Spark Platform, allows users to write their deep learning applications as standard Spark programmes that can directly run on top of existing Spark or Hadoop clusters. It allows the exporting of artificial intelligence expertise to data scientists that currently work across several applications in various fields. BigDL is modeled after Torch, an open source deep learning framework used in scientific computing.