Text Classification with Machine Learning vs Deep Learning

The preprocessing part of the pipeline is a very important step, as it can impact greatly the model's performance. Depending on which model will be used, the original text may need to be modified so it has the most appropriate format to feed the model. When using Bag of Words, we want all similar words (e.g. To do this, we will extract the lemma of every token in the text and remove all stop words and every symbol that won't contribute to the model, which translates into lemmatization and cleaning of the text. On the other hand, if the context of the text is what we aim to focus on, then different words should not be merged into a single base form.