Machine Translation
The Real Problems with Neural Machine Translation
TLDR: No! Your Machine Translation Model is not "prophesying", but let's look at the six major issues with neural machine translation (NMT). So I saw a Twitter thread today with the editor-in-chief of Motherboard tweeting, "Google Translate is popping out bizarre religious texts and no one is sure why". I am going to spend a little time on the "why" part (folks who work in MT know why), but mostly focus on actual problems with neural machine translation. The choice of headlines, the promotion tweet, and the tone of the article reminds me of all the irresponsible writing that went around the famous "Facebook Frankenstein" experiment. I would not be surprised if other media outlets picked up this Motherboard piece and ran ridiculous stories about machine translation conspiracy theories.
A Comprehensive Survey of Deep Learning for Image Captioning
Hossain, Md. Zakir, Sohel, Ferdous, Shiratuddin, Mohd Fairuz, Laga, Hamid
These sources contain images that viewers would have to interpret themselves. Most images do not have a description, but the human can largely understand them without their detailed captions. However, machine needs to interpret some form of image captions if humans need automatic image captions from it. Image captioning is important for many reasons. For example, they can be used for automatic image indexing. Image indexing is important for Content-Based Image Retrieval (CBIR) and therefore, it can be applied to many areas, including biomedicine, commerce, the military, education, digital libraries, and web searching. Social media platforms such as Facebook and Twitter can directly generate descriptions from images. The descriptions can include where we are (e.g., beach, cafe), what we wear and importantly what we are doing there.
3 reasons why AI won't replace human translators... yet
Humans may have forfeited our lead in recognizing tumours or judging credit risk, but we still have, and may always have, the final authority over what is or isn't "natural" in a natural language. This authority is reflected in the metric of choice for evaluating machine translation algorithms - the BLEU (bilingual evaluation understudy) - which scores candidate translations based on their similarities to a human professional's work. "The closer a machine translation is to a professional human translation, the better it is", concede the framework's inventors.
Google Translate adds real-time translations for 13 new languages
Google announced this week that its Translate app for iOS and Android recognize 13 new languages through your smartphone's camera. The update, which includes support for Arabic and Hindi, is in the process of being rolled out to Translate users worldwide, per VentureBeat. In addition to Arabic and Hindi, the app now supports Bengali and Punjabi--four of the top 10 most spoken languages in the world, according to Ethnologue. Translate also added support for Gujarati, Kannada, Malayalam, Marathi, Nepali, Tamil, Telugu, Thai, and Vietnamese. Google Translate's "See" and "Snap" features allow you to point your camera at a sign or menu and watch the app translate the text in real time, or take a quick picture and let the app process any translatable text for you.
For AI, translation is about more than language
What did Claude Monet see as he placed his easel by the bank of the Seine near Argenteuil on a lovely spring day in 1873? A color photograph, had it been invented, may have documented a crisp blue sky and a glassy river reflecting it. Monet conveyed his impression of this same scene through wispy brush strokes and a bright palette. What if Monet had happened upon the little harbor in Cassis on a cool summer evening? A brief stroll through a gallery of Monet paintings makes it possible to imagine how he would have rendered the scene: perhaps in pastel shades, with abrupt dabs of paint, and a somewhat flattened dynamic range.
The Impact of Annotation Guidelines and Annotated Data on Extracting App Features from App Reviews
Shah, Faiz Ali, Sirts, Kairit, Pfahl, Dietmar
Annotation guidelines used to guide the annotation of training and evaluation datasets can have a considerable impact on the quality of machine learning models. In this study, we explore the effects of annotation guidelines on the quality of app feature extraction models. As a main result, we propose several changes to the existing annotation guidelines with a goal of making the extracted app features more useful and informative to the app developers. We test the proposed changes via simulating the application of the new annotation guidelines and then evaluating the performance of the supervised machine learning models trained on datasets annotated with initial and simulated guidelines. While the overall performance of automatic app feature extraction remains the same as compared to the model trained on the dataset with initial annotations, the features extracted by the model trained on the dataset with simulated new annotations are less noisy and more informative to the app developers. Secondly, we are interested in what kind of annotated training data is necessary for training an automatic app feature extraction model. In particular, we explore whether the training set should contain annotated app reviews from those apps/app categories on which the model is subsequently planned to be applied, or is it sufficient to have annotated app reviews from any app available for training, even when these apps are from very different categories compared to the test app. Our experiments show that having annotated training reviews from the test app is not necessary although including them into training set helps to improve recall. Furthermore, we test whether augmenting the training set with annotated product reviews helps to improve the performance of app feature extraction. We find that the models trained on augmented training set lead to improved recall but at the cost of the drop in precision.
Exploring the Use of Attention within an Neural Machine Translation Decoder States to Translate Idioms
Salton, Giancarlo D., Ross, Robert J., Kelleher, John D.
Idioms pose problems to almost all Machine Translation systems. This type of language is very frequent in day-to-day language use and cannot be simply ignored. The recent interest in memory augmented models in the field of Language Modelling has aided the systems to achieve good results by bridging long-distance dependencies. In this paper we explore the use of such techniques into a Neural Machine Translation system to help in translation of idiomatic language.
End-to-End Content and Plan Selection for Data-to-Text Generation
Gehrmann, Sebastian, Dai, Falcon Z., Elder, Henry, Rush, Alexander M.
Learning to generate fluent natural language from structured data with neural networks has become an common approach for NLG. This problem can be challenging when the form of the structured data varies between examples. This paper presents a survey of several extensions to sequence-to-sequence models to account for the latent content selection process, particularly variants of copy attention and coverage decoding. We further propose a training method based on diverse ensembling to encourage models to learn distinct sentence templates during training. An empirical evaluation of these techniques shows an increase in the quality of generated text across five automated metrics, as well as human evaluation.
Understanding the Origins of Bias in Word Embeddings
Brunet, Marc-Etienne, Alkalay-Houlihan, Colleen, Anderson, Ashton, Zemel, Richard
The power of machine learning systems not only promises great technical progress, but risks societal harm. As a recent example, researchers have shown that popular word embedding algorithms exhibit stereotypical biases, such as gender bias. The widespread use of these algorithms in machine learning systems, from automated translation services to curriculum vitae scanners, can amplify stereotypes in important contexts. Although methods have been developed to measure these biases and alter word embeddings to mitigate their biased representations, there is a lack of understanding in how word embedding bias depends on the training data. In this work, we develop a technique for understanding the origins of bias in word embeddings. Given a word embedding trained on a corpus, our method identifies how perturbing the corpus will affect the bias of the resulting embedding. This can be used to trace the origins of word embedding bias back to the original training documents. Using our method, one can investigate trends in the bias of the underlying corpus and identify subsets of documents whose removal would most reduce bias. We demonstrate our techniques on both a New York Times and Wikipedia corpus and find that our influence function-based approximations are extremely accurate.
Google Translate for iOS can speak in your local accent
Until now, using Google Translate on your iPhone has meant listening to the same pronunciation for translations no matter where you live. That's not very considerate, and potentially a problem if you live in countries where foreign accents could make comprehension difficult. You won't have that issue from now on -- an update to Google Translate has added speech output in local versions of multiple languages, including English, Bengali, French and Spanish. You can hear English results with an Indian accent, for instance, or listen to French with a Canadian spin. Android has included these speech options for a while.