Machine Translation
Peeking into the neural network architecture used for Google's Neural Machine Translation
The Google Neural Machine Translation paper (GNMT) describes an interesting approach towards deep learning in production. The paper and architecture are non-standard, in many cases deviating far from what you might expect from an architecture you'd find in an academic paper. Emphasis is placed on ensuring the system remains practical rather than chasing the state of the art through typical but computationally intensive tweaks. To understand the model used in GNMT we'll start with a traditional encoder decoder machine translation model and keep evolving it until it matches GNMT. The GNMT evolution seems primarily motivated by improving accuracy while maintaining practical production speeds for both training and prediction. The encoder decoder architecture started the recent neural machine translation trend.
Google Translate: 'This landmark update is our biggest single leap in 10 years'
Google AI uses neural networks to guess what you're drawing AI'Singularity' May Take A While, Google Executive Says Google Translate: 'This landmark update is our biggest single leap in 10 years' Is Google Cloud Machine Learning enterprise-ready? Stay up-to-date on the topics you care about. We'll send you an email alert whenever a news article matches your alert term. It's free, and you can add new alerts at any time.
Google Translate just got a lot smarter
Google says its Translate app now spits back more natural translations. Google said Tuesday it has vastly improved its Google Translate app, available on phones and the web. The search giant said it's now incorporating "neural machine translation" into the software, which means it can translate whole sentences at a time, instead of breaking the text down to smaller chunks and translating those pieces. The result is translations coming out more natural, with better syntax and grammar, Google said. "It has improved more in one single leap than in 10 years combined," Barak Turovsky, the product lead for Google Translate, said during a press event at Google's San Francisco office.
Google Translate is tapping into neural networks for smarter language learning
Google Translate is rolling out a major upgrade that promises more human-like language translations. Google is bullish on its Neural Machine Translation technology, claiming that it's a bigger upgrade to the service than everything that's been accomplished in the last ten years combined. The company is rolling out the improvements to eight language pairs in Google search, the Translate apps, and the website. You'll find the new technology behind translations between English and French, German, Spanish, Portuguese, Chinese, Japanese, Korean and Turkish. Google says that makes up more than 35 percent of all language queries.
Google's Translation App Is About To Get Much Better
Google is improving its language translation service with a new approach that interprets whole sentences at a time rather than phrases piece-by-piece, the search giant announced Tuesday. The firm says that should make translations from the service, called Google Translate, easier to understand. "It uses this broader context to help it figure out the most relevant translation, which it then arranges and adjusts to be more like a human speaking with proper grammar," Barak Turovsky, product lead for Google Translate, wrote in a new blog post. This new version of Google Translate is powered by neutral machine translation, which is a new method of teaching computers to translate human languages, according to the Association for Computational Linguistics. Google published updates regarding its research into this field in September; it's now integrating the technique directly into Google Translate.
Google expands mission to make automated translations suck less
What started with Mandarin Chinese is expanding to English; French; German; Japanese; Korean; Portuguese and Turkish, as Google has increased the languages its Neural Machine Translation (NMT) handle. "These represent the native languages of around one-third of the world's population, covering more than 35 percent of all Google Translate queries," according to The Keyword blog. The promise here is that because NMT uses the context of the entire sentence, rather than translating individual words on their own, the results will be more accurate, especially as time goes on, thanks to machine learning. For a comparison of the two methods, check out the GIF embedded below. Google says that the ultimate goal is to have all 103 languages in Translate using machine learning.
Google Translate just got a lot smarter
Google says its Translate app now spits back more natural translations. Google said Tuesday that it has vastly improved its Google Translate app, available on phones and the web. The search giant said it's now incorporating "neural machine translation" into the software, which translates whole sentences at a time, instead of breaking the text down to smaller chunks and translating those pieces. That means translations come out more natural, with better syntax and grammar. "It has improved more in one single leap than in 10 years combined," said Barak Turovsky, the product lead for Google Translate, during a press event at Google's San Francisco office. The new translation system is coming to eight of the 103 languages supported by the app.
WIPO DG Gurry on WIPO's "Artificial Intelligence" Translation Tool for Patents
WIPO Director General Francis Gurry speaks about WIPO's ground-breaking new "artificial intelligence"-based translation tool for patent documents, a new service that hands innovators around the world the highest-quality service yet available for accessing information on new technologies. WIPO Translate now incorporates cutting-edge neural machine translation technology to render highly technical patent documents into a second language in a style and syntax that more closely mirror common usage, out-performing other translation tools built on previous technologies.
Import AI: Changes at Twitter Cortex, Catastrophic Forgetting, and a $1000 bet
Reusability: One of the reasons why AI progress is accelerating is the community is creating more and more reusable components that can be plugged into different domains, frequently attaining performance equivalent to or better than hand-designed algorithms. The 2015 ImageNet challenge was won by a Microsoft system built out of Residual Networks, then in 2016 Microsoft made a speech processing breakthrough via a system that also relied on Residual Networks. Similarly, DeepMind's WaveNet system has been slightly tweaked and re-applied to the domain of neural machine translation (PDF). This kind of re-use is a good thing as it suggests we are beginning to create the right sorts of low-level primitives that general intelligences can be built out of.