A Representation Descriptions GloVE

Neural Information Processing Systems 

It is an dimensionality-representation representation of word-word co-occurrence statistics. We used the Flair NLP [1] implementation of BERT embeddings. NWE is the GloV erepresentation, offset by one word in the future. Representations were built using a sliding window of 64 words as a context. HuggingFace [41] implementation of this network to extract feature for these representations.