Extend structured streaming for Spark ML
To learn more about Structured Streaming and Machine Learning, check out Holden Karau's and Seth Hendrickson's session Spark Structured Streaming for machine learning at Strata Hadoop World New York, September 26-29, 2016. Spark's new ALPHA Structured Streaming API has caused a lot of excitement because it brings the Data set/DataFrame/SQL APIs into a streaming context. In this initial version of Structured Streaming, the machine learning APIs have not yet been integrated. However, this doesn't stop us from having fun exploring how to get machine learning to work with Structured Streaming. For our Spark Structured Streaming for machine learning talk on at Strata Hadoop World New York 2016, we've started early proof-of-concept work to integrate structured streaming and machine learning available in the spark-structured-streaming-ml repo.
Oct-22-2016, 20:06:13 GMT
- Country:
- North America > United States
- New York (0.46)
- California > San Francisco County
- San Francisco (0.05)
- North America > United States
- Technology: