T5: Text-To-Text Transfer Transformer

With the burgeoning of Transfer Learning, Deep Learning has achieved many wonders. In this article, we'll discuss Google's state of the art, T5 -- Text-to-Text Transfer Transformer Model which was proposed earlier this year in the paper, "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer". This paper is essentially a survey of modern transfer learning techniques used in language understanding and hence proposes a unified framework that attempts to combine all language problems into a text-to-text format. We will discuss this approach in greater detail in the coming sections. Moreover, the authors have also open-sourced a new dataset (for facilitating their work) called C4 -- Colossal Clean Crawled Corpus.