real time machine learning visualization
Real Time Machine Learning Visualization and Spark Tuning
The only way to monitor progress is to view the status of the Spark jobs, which provides no information about convergence or other statistics of interest. In this talk, we will discuss how to visualize and monitor the training of machine learning models in real-time with Spark. With this capability, you can monitor machine learning training from one iteration to the next, observe how the model converges during each iteration, visualize the characteristics of the model in real time, and decide if you wish to continue to train the model. Talk 2: SPARK TUNING FOR ENTERPRISE SYSTEM ADMINISTRATORS Speaker: Anya Bida, Rachel Warren Spark offers the promise of speed, but many enterprises are reluctant to make the leap from Hadoop to Spark. Indeed, System Administrators will face many challenges with tuning Spark performance.