Timeseries Data Analysis of IoT events by using Jupyter Notebook - developerWorks Recipes

In the previous recipe "Engage Machine Learning for detecting anomalous behaviors of things", we saw how one can integrate IBM Watson IoT, Apache Spark service, Predictive Analysis service and Real-Time Insights to take timely action before an (unacceptable) event occurs. And in this recipe, we will make use of the data (historical data) produced by the previous recipe to discover the hiddern patterns, termperature trend over the days, month and year using Apache Spark SQL, Pandas DataFrame and Jupyter Notebook. Apache Spark SQL is a Spark module for structured data processing. Unlike the basic Spark RDD API, the interfaces provided by Spark SQL provide Spark with more information about the structure of both the data and the computation being performed. Internally, Spark SQL uses this extra information to perform extra optimizations.