pytorch/fairseq

Fairseq(-py) is a sequence modeling toolkit that allows researchers and developers to train custom models for translation, summarization, language modeling and other text generation tasks. We also provide pre-trained models for several benchmark translation datasets. If you use Docker make sure to increase the shared memory size either with --ipc host or --shm-size as command line options to nvidia-docker run. This model uses a Byte Pair Encoding (BPE) vocabulary, so we'll have to apply the encoding to the source text before it can be translated. This can be done with the apply_bpe.py