Data Science and Machine Learning with Scala and Spark (Episode 02/03)

Spark's inventors chose Scala to write the low-level modules. In Data Science and Machine Learning with Scala and Spark (Episode 01/03), we covered the basics of Scala programming language while using a Google Colab environment. In this article, we learn about the Spark ecosystem and its higher-level API for Scala users. As before, we still use Spark 3.0.0 Apache Spark is a unified computing engine and a set of libraries for parallel data processing on computer clusters.