Part of Speech Tagging with Hidden Markov Chain Models

Part of Speech Tagging (POS) is a process of tagging sentences with part of speech such as nouns, verbs, adjectives and adverbs, etc. Hidden Markov Models (HMM) is a simple concept which can explain most complicated real time processes such as speech recognition and speech generation, machine translation, gene recognition for bioinformatics, and human gesture recognition for computer vision, and more. In this post, we will use the Pomegranate library to build a hidden Markov model for part of speech tagging. We will not go into the details of statistical part-of-speech tagger. However, if you are interested, here is the paper. The data is a copy of the Brown corpus and can be found here.