Using SparkML to Power a DSaaS (Data Science as a Service)

In this talk we will show how many common use cases use the common algorithms like Logistic Regression, Random Forest, Decision Trees, Clustering, NLP etc. Spark has several Machine Learning algorithms built in and has excellent scalability. We will show how we solved some of the problems of establishing feature vectors, choosing algorithms and then deploying models into production. We will showcase our use of Scala, R and Python to implement models using language of choice yet deploying quickly into production on 500 node Spark clusters.