Neural machine translation (NMT) heavily relies on word-level modelling to learn semantic representations of input sentences.However, for languages without natural word delimiters (e.g., Chinese) where input sentences have to be tokenized first,conventional NMT is confronted with two issues:1) it is difficult to find an optimal tokenization granularity for source sentence modelling, and2) errors in 1-best tokenizations may propagate to the encoder of NMT.To handle these issues, we propose word-lattice based Recurrent Neural Network (RNN) encoders for NMT,which generalize the standard RNN to word lattice topology.The proposed encoders take as input a word lattice that compactly encodes multiple tokenizations, and learn to generate new hidden states from arbitrarily many inputs and hidden states in preceding time steps.As such, the word-lattice based encoders not only alleviate the negative impact of tokenization errors but also are more expressive and flexible to embed input sentences.Experiment results on Chinese-English translation demonstrate the superiorities of the proposed encoders over the conventional encoder.

Building bilingual lexica from non-parallel data is a long-standing natural language processing research problem that could benefit thousands of resource-scarce languages which lack parallel data. Recent advances of continuous word representations have opened up new possibilities for this task, e.g. by establishing cross-lingual mapping between word embeddings via a seed lexicon. The method is however unreliable when there are only a limited number of seeds, which is a reasonable setting for resource-scarce languages. We tackle the limitation by introducing a novel matching mechanism into bilingual word representation learning. It captures extra translation pairs exposed by the seeds to incrementally improve the bilingual word embeddings. In our experiments, we find the matching mechanism to substantially improve the quality of the bilingual vector space, which in turn allows us to induce better bilingual lexica with seeds as few as 10.

Neural Machine Translation (NMT) is a new approach to machine translation that has made great progress in recent years. However, recent studies show that NMT generally produces fluent but inadequate translations (Tu et al. 2016b; 2016a; He et al. 2016; Tu et al. 2017). This is in contrast to conventional Statistical Machine Translation (SMT), which usually yields adequate but non-fluent translations. It is natural, therefore, to leverage the advantages of both models for better translations, and in this work we propose to incorporate SMT model into NMT framework. More specifically, at each decoding step, SMT offers additional recommendations of generated words based on the decoding information from NMT (e.g., the generated partial translation and attention history). Then we employ an auxiliary classifier to score the SMT recommendations and a gating function to combine the SMT recommendations with NMT generations, both of which are jointly trained within the NMT architecture in an end-to-end manner. Experimental results on Chinese-English translation show that the proposed approach achieves significant and consistent improvements over state-of-the-art NMT and SMT systems on multiple NIST test sets.

Machine intelligence is everywhere in facial recognition at airports to emotional sensing algorithms; machine generated Art work; legal and medical advisory search to sometimes fowl mouthed social chat bots. The Google company AI team recently announced they developed Google Neural Machine Translation system, GNMT, using a new technique that is improving results to near human translation speed accuracy. These advances that Google describe as machine translation at production scale, are testament to the rapid real-time advancement of AI into human experience and intelligence as well as beyond human capabilities. Andrew Ng of Stanford and Chief Scientist at Baidu Research famously said that word translation of 95% is 1 in every 20 words would likely be wrong, going to 99% is game changing. Andrew was quoted in a recent HBR article saying, "If a typical person can do a mental task with less than one second of thought, we can probably automate it using AI either now or in the near future."

This paper tackles the reduction of redundant repeating generation that is often observed in RNN-based encoder-decoder models. Our basic idea is to jointly estimate the upper-bound frequency of each target vocabulary in the encoder and control the output words based on the estimation in the decoder. Our method shows significant improvement over a strong RNN-based encoder-decoder baseline and achieved its best results on an abstractive summarization benchmark.

Back in September 2016, Google launched its Neural Machine Translation (GNMT) system, which uses deep learning to deliver more natural translations between languages. Google Translate originally supported only a handful of languages when it launched 10 years ago; today that number has risen to 103. Creating a computer system to translate multiple languages is complex. The people at Google who built it wanted to find out just how clever their system was. So they came up with a challenge.

Neural networks are machines and algorithms developed to behave like the human brain--but a development from Google Translate shows that (once again) AI can outperform humans in a big way. Google's AI can now translate language pairs it has not been trained for. To be clear, this means that it can translate between languages that it wasn't taught to translate. This works if the AI first translates both of the languages into a common language that it knows. The development is detailed in a paper published on Cornell University's arXiv.

Over the few past years, the demand for real-time interpretation services has increased considerably. The globalisation of business can be considered a huge contributing factor for this phenomenon, as it has increased the opportunities for international trade and opened new markets for businesses all around the world. In order to be competitive and keep up with this increase in demand for interpreting services, developers have been working on technological solutions to meet the requirements for high-quality simultaneous interpretations, but can tech really replace humans when it comes to interpreting? Real-time translation systems include applications that can be installed on smartphones, computers, or other gadgets linked to the Internet. The words of the speaker are transcribed by a computer server, which analyses the content and selects the closest translation from a vast collection of phrase pairs in its database.

AI-complete problems are ones likely to contain all or most of human-level general artificial intelligence. A few problems in this category are listed below. Open-domain dialog is the problem of conducting competently a dialog with a human when the subject of the discussion is not known in advance. The challenge includes language understanding, dialog pragmatics, and understanding the world. Versions of the tasks include spoken and written dialog.

Creating a computer system to translate multiple languages is complex. The people at Google who built it wanted to find out just how clever their system was. So they came up with a challenge. They taught the machine to translate English to Japanese and vice versa. Then they taught it to translate English to Korean and also the reverse translation.