End to End Machine Learning: From Data Collection to Deployment

This started out as a challenge. With a friend of mine, we wanted to see if it was possible to build something from scratch and push it to production. In this post, we'll go through the necessary steps to build and deploy a machine learning application. This starts from data collection to deployment and the journey, as you'll see it, is exciting and fun . Before we begin, let's have a look at the app we'll be building: As you see, this web app allows a user to evaluate random brands by writing reviews. While writing, the user will see the sentiment score of his input updating in real-time along with a proposed rating from 1 to 5. The user can then change the rating in case the suggested one does not reflect his views, and submit. You can think of this as a crowd sourcing app of brand reviews with a sentiment analysis model that suggests ratings that the user can tweak and adapt afterwards. To build this application we'll follow these steps: All the code is available in our github repository and organized in independant directories, so you can check it, run it and improve it. Disclaimer: The scripts below are meant for educational purposes only: scrape responsibly. In order to train a sentiment classifier, we need data. We can sure download open source datasets for sentiment analysis tasks such as Amazon Polarity or IMDB movie reviews but for the purpose of this tutorial, we'll build our own dataset.