Deep Learning -- NLP (Part V- b)

Continuing with the previous story, in this post we are going to go over an example of text preparation of the sentiment analysis of a movie review dataset. The dataset is classified into positive reviews and negative review; all positive reviews are stored in pos directory, and all negative in neg directory. Each review is in a separate file. First, we need to split the data into training data and testing data prior to any data preparation. This means that any knowledge in the test set that could help us better prepare the data is unavailable during the preparation of the data and the training of the model.