Goto

Collaborating Authors

 Machine Translation


Dynamic Multi-Level Multi-Task Learning for Sentence Simplification

arXiv.org Artificial Intelligence

Sentence simplification aims to improve readability and understandability, based on several operations such as splitting, deletion, and paraphrasing. However, a valid simplified sentence should also be logically entailed by its input sentence. In this work, we first present a strong pointer-copy mechanism based sequence-to-sequence sentence simplification model, and then improve its entailment and paraphrasing capabilities via multi-task learning with related auxiliary tasks of entailment and paraphrase generation. Moreover, we propose a novel 'multi-level' layered soft sharing approach where each auxiliary task shares different (higher versus lower) level layers of the sentence simplification model, depending on the task's semantic versus lexico-syntactic nature. We also introduce a novel multi-armed bandit based training approach that dynamically learns how to effectively switch across tasks during multi-task learning. Experiments on multiple popular datasets demonstrate that our model outperforms competitive simplification systems in SARI and FKGL automatic metrics, and human evaluation. Further, we present several ablation analyses on alternative layer sharing methods, soft versus hard sharing, dynamic multi-armed bandit sampling approaches, and our model's learned entailment and paraphrasing skills.


Unsupervised Word Segmentation from Speech with Attention

arXiv.org Artificial Intelligence

We present a first attempt to perform attentional word segmentation directly from the speech signal, with the final goal to automatically identify lexical units in a low-resource, unwritten language (UL). Our methodology assumes a pairing between recordings in the UL with translations in a well-resourced language. It uses Acoustic Unit Discovery (AUD) to convert speech into a sequence of pseudo-phones that is segmented using neural soft-alignments produced by a neural machine translation model. Evaluation uses an actual Bantu UL, Mboshi; comparisons to monolingual and bilingual baselines illustrate the potential of attentional word segmentation for language documentation.


Google Translate offline translations will get better with machine learning

#artificialintelligence

Google began their foray into the AI and machine intelligence sectors thanks to the computing power they're able to leverage in the company's data centers. This worked out great as it allowed people all around the world to see how beneficial it was without needing to invest in new hardware. This was when they started to develop their own hardware to handle these computational cycles, and that saved the company a ton of money as this was better designed to handle the tasks required for quick and efficient machine learning algorithms. The latest extension of their progress has come in the form of on-device machine learning hardware. Today, the company showed how Google Translate benefits from using on-device machine learning technology.


Google Translate is rolling out offline AI-based translations that you can download

#artificialintelligence

Google has rolled out offline downloads for its AI-powered translator. So if you don't have unlimited data or you have a plan that doesn't work internationally, you can now download neural machine translation from Google's Android and iOS apps. But whether you were figuring your way through a foreign menu or deciphering cool storefronts, you may have discovered that the dictionary's quite literal translations don't fully grasp the nuances of a foreign language, even if the language is Spanish or French, which are quite similar to English. The plight doubles when you're trying to decipher a language with a different alphabet and roots, like Russian or Chinese, where even the AI-based translator makes mistakes. Google Translate's offline AI translations will first be available in 59 languages, including English, Arabic, Chinese, German, and Hindi, to name a few.


How To Create a ChatBot With tf-seq2seq For Free! โ€“ Deep Learning as I See It

#artificialintelligence

Disclaimer: Our opinions are our own. Let me quote authors of the framework. In this article we will be using it to train a chatbot. More precisely we will be using the following tutorial for neural machine translation (NMT). If you wonder how an NMT model could be used for a chatbot, please see my previous article ("Own ChatBot Based on Recurrent Neural Network for 6$/6 hours and 100 lines of code.").


A Computer Architect Cottage Industry

Forbes - Tech

In the 18th century home craft textile workers were displaced by mass production in organized factories. Some of these displaced workers destroyed knitting equipment in these new factories. In England, Ned Ludd, also known as Capitain Ludd or King Ludd, the mythical leader of the Luddites, was the inspiration of a widespread effort to destroy factory equipment and return to the cottage industry that had sustained local economies before the development of the steam engine and the industrial revolution. Industrialization destroyed early cottage economies, but today, advanced technology and the slowing of semiconductor scaling may bring about a renaissance of cottage industry. This is the result of minimizing the cost of technology development with new cloud-based tools and internet enabled supply chains.


Google brings offline neural machine translations for 59 languages to its Translate app

#artificialintelligence

Currently, when the Google Translate apps for iOS and Android has access to the internet, its translations are far superior to those it produces when it's offline. That's because the offline translations are phrase-based, meaning they use an older machine translation technique than the machine learning-powered systems in the cloud that the app has access to when it's online. Google is now rolling out offline Neural Machine Translation (NMT) support for 59 languages in the Translate apps. Today, only a small number of users will see the updated offline translations, but it will roll out to all users within the next few weeks. The list of supported languages consists of a wide range of languages.


Google Translate's AI help is now available offline

Daily Mail - Science & tech

Being tongue-tied on holiday could become a thing of the past thanks to a major update to Google's Translate feature. Two years ago it introduced translating AI called'neural machine translation (NMT)' to improve the accuracy of translations - and now this is available offline. Phones running on both iOS and Android will be able to take advantage of the new update and it will be available in 59 languages. Two years ago Google introduced translating AI called'neural machine translation (NMT)' to improve the accuracy of translations - and now this is available offline Google says that each language won't take up too much storage - just 35 to 45Mb. It also uses broader context to help determine the most relevant translation, which it then rearranges and adjusts to sound more like a real person speaking with proper grammar.


Google Translate offline is set to get a boost with machine learning

#artificialintelligence

Google has gone a long way in making our lives easier and this is evident from the fact that we use some of its products everyday in our lives. Google Translate is one of those products from the company that is boon for travelers going to places where they don't speak the native language. Google Translate works just fine in terms of technicality, but there is always room for improvement. Google made sure that people can access its Translate feature even in areas with patchy, or no network with the offline feature. And in a recent blog post Google declared that the offline services is about to get better with the integration of neural machine translation or NMT.


Google AI makes international business communication easier with offline translation

#artificialintelligence

Neural machine translations (NMT) in the Google Translate application now works offline on both iPhone and Android, product manager Julie Cattiau announced in a blog post on Tuesday. Prior to this update, translations in the app were phrase-based, meaning sentences would be translated in chunks. The update will roll out in the next few weeks, according to the post. The offline functionality could be useful for international business travelers, especially those who travel to regions with spotty Wi-Fi or poor signal. The NMT functionality could also ease communication due to its more accurate translations.