A Data Model for Training and Scoring 5 Members Events Event RSVPs Model Member Predicted RSVP Offline Training Real-Time Scoring 6. Component Integration and Serving 6 Kinesis Producer AWS S3 Spark Model Training Spark Structured Streaming Meetup Stream Meetup Member API Meetup Prediction 7. Producing the Kinesis Firehose Stream 7 requests.get() Save the model to disk for scoringmodel.write.overwrite().save(...) 10. Scoring the Model in Real-time 10 Load the trained modelval model PipelineModel.load(...) Stream meetup event data Score the model val events spark.readStream ML Limitations in Structured Streaming 11 •Structured streaming does not support operations needed by ML methods –count, collect, round, aggregate*, etc. • Many models, transformers, and estimators are not supported –K-Means, SVM, CountVectorizer, VectorAssembler, StringIndexer, etc. 12.