Machine Learning with ML.NET - NLP with BERT

During the training, process Encoder is supplied with word embeddings from the English language. Computers don't understand words, they understand numbers and matrixes (set of numbers). That is why we convert words into some vector space, meaning we assign certain vectors (map them to some latent vector space) to each word in the language. There are many available word embeddings like Word2Vec. However, the position of the word in the sentence is also important for the context.