Spark tutorial: Get started with Apache Spark

Apache Spark has become the de facto standard for processing data at scale, whether for querying large datasets, training machine learning models to predict future trends, or processing streaming data. In this article, we'll show you how to use Apache Spark to analyze data in both Python and Spark SQL. And we'll extend our code to support Structured Streaming, the new current state of the art for handling streaming data within the platform. We'll be using Apache Spark 2.2.0 here, but the code in this tutorial should also work on Spark 2.1.0 Before we begin, we'll need an Apache Spark installation.