Navigating with Graph Representations for Fast and Scalable Decoding of Neural Language Models

First, we construct asmall world graphrepresentation [31, 32] of a vocabulary. The nodes inthegraph arewords, each being represented using acontinuous vector transformed from its word embedding vector in the NLM.