Deep Learning at x.ai - x.ai

When a RNN is trained on sequences of words, it learns to represent each word as a high dimensional vector which encodes the model's understanding of that word. If you take a step back and view the image as a whole, the large scale structure of the image is determined by words' part of speech. Nouns tend to lie in the center of the image, verbs tend to lie on the upper right side, and first names form a large orange cluster in the bottom left part of the image. The RNN learned all of this semantic understanding without a human ever having to code a definition of concepts like nouns, verbs, universities, cities, meetings, or social media.