Train sklearn 100x Faster - KDnuggets

At Ibotta we train a lot of machine learning models. They make predictions for millions of users as they interact with our mobile app. While we do much of our data processing with Spark, our preferred machine learning framework is scikit-learn. As compute gets cheaper and time to market for machine learning solutions becomes more critical, we've explored options for speeding up model training. One of those solutions is to combine elements from Spark and scikit-learn into our own hybrid solution.