SVD-Softmax: Fast Softmax Approximation on Large Vocabulary Neural Networks

Kyuhong Shim, Minjae Lee, Iksoo Choi, Yoonho Boo, Wonyong Sung

Neural Information Processing Systems 

We propose a fast approximation method of a softmax function with a very large vocabulary using singular value decomposition (SVD).

Similar Docs  Excel Report  more

TitleSimilaritySource
None found