Augment Your Small Dataset Using Transformers and Synonym Replacement for Sentiment Analysis-- Part…

Its uniqueness lies in its'self-supervised', pre-training objective architecture. Unlike other models that infer on the meaning of a sentence by extracting small parts of it, Pegasus completely'masks' the sentence and tries to find it by reading the text before and after it. Pegasus is really good at data summarization, but it is also great at paraphrasing sentences. The model is extremely easy to use, doesn't require many dependencies and with just a few lines of code we'll have our augmented dataset ready for training. To be able to leverage our small dataset efficiently, we will be performing text Paraphrasing along with Synonym Replacement to come up with a dataset large and unique enough to train our Sentiment Analysis model with.