Oceania
Memory limitations are hidden in grammar
Gómez-Rodríguez, Carlos, Christiansen, Morten H., Ferrer-i-Cancho, Ramon
For many centuries, the goal of linguistics has been to capture this capacity by a formal description--a grammar--consisting of a systematic set of rules and/or principles that determine which sentences are part of a given language and which are not (Bod, 2013). Over the years, these formal grammars have taken many forms but common to them all is the assumption that they capture the idealized linguistic competence of a native speaker/hearer, independent of any memory limitations or other non-linguistic cognitive constraints (Chomsky, 1965; Miller, 2000). These abstract formal descriptions have come to play a foundational role in the language sciences, from linguistics, psycholinguistics, and neurolinguistics (Hauser et al., 2002; Pinker, 2003) to computer science, engineering, and machine learning (Klein and Manning, 2003; Dyer et al., 2016; Gómez-Rodríguez et al., 2018). Despite evidence that processing difficulty underpins the unacceptability of certain sentences (Morrill, 2010; Hawkins, 2004), the cognitive independence assumption that is a defining feature of linguistic competence has not been examined in a systematic way using the tools of formal grammar. It is therefore unclear whether these supposedly idealized descriptions of language are free of non-linguistic cognitive constraints, such as memory limitations.
Benchmarking Generative Latent Variable Models for Speech
Havtorn, Jakob D., Borgholt, Lasse, Hauberg, Søren, Frellsen, Jes, Maaløe, Lars
Stochastic latent variable models (LVMs) achieve state-of-the-art performance on natural image generation but are still inferior to deterministic models on speech. In this paper, we develop a speech benchmark of popular temporal LVMs and compare them against state-of-the-art deterministic models. We report the likelihood, which is a much used metric in the image domain, but rarely, or incomparably, reported for speech models. To assess the quality of the learned representations, we also compare their usefulness for phoneme recognition. Finally, we adapt the Clockwork VAE, a state-of-the-art temporal LVM for video generation, to the speech domain. Despite being autoregressive only in latent space, we find that the Clockwork VAE can outperform previous LVMs and reduce the gap to deterministic models by using a hierarchy of latent variables.
Birds are more colourful near the equator, new study proves
Two centuries after Charles Darwin put the theory forward, a new study finally shows that birds living near the equator are more colourful. Scientists have used artificial intelligence (AI) to identify the amount of colour in photos of over 24,000 preserved birds from the Natural History Museum's collection. Tropical birds living near the equator are roughly 30 per cent more colourful than non-tropical birds living nearer the poles, the scientists found, but they don't know exactly why. The long-held theory, first suspected by Charles Darwin and other naturalists in the 18th and 19th centuries, hasn't been proven until now, the experts say. Research from the University of Sheffield found tropical birds living near the equator are roughly 30 per cent more colourful than non-tropical birds living nearer the poles.
Alphabet's Wing will begin drone deliveries in Dallas-Fort Worth on April 7th
Alphabet's Wing division has announced that it's launching a drone delivery service in the Dallas-Fort Worth (DFW) metroplex on April 7th. "With this service, the DFW area will be the largest metro in the world, and the first in the United States, with access to on-demand drone delivery," a company spokesperson said in an emailed statement. Wing's primary launch customer is Walgreens, which will deliver health and wellness products directly to customer's homes. For that, it will use a new operational model where drones are staged at one of its own store parking lots, rather than a Wing facility. It will also be delivering ice cream from Blue Bell Creameries, Easyvet prescription pet medications (yep) and first aid kits from Texas Health.
Developing an AI-powered app to identify invasive bugs
A team member using a 3D imaging system to take images of stink bugs from many angles to train the AI model inside the app. This requires several hundred images per species. Australia's national science agency, CSIRO, is using artificial intelligence (AI) to develop an app that will help keep brown marmorated stink bugs out of Australia, an invasive species with the potential to wipe out more than 300 different species of plants if it made it past quarantine. The app, being developed for the Department of Agriculture, Water and the Environment (DAWE), is based on a prototype co-funded by Microsoft to identify seeds of noxious weedy daisies, using AI to identify stink bug species based on thousands of specimens held in CSIRO's National Research Collections Australia. DAWE is now trialling the app in its quarantine stations.
VLSP 2021 - ViMRC Challenge: Vietnamese Machine Reading Comprehension
Van Nguyen, Kiet, Tran, Son Quoc, Nguyen, Luan Thanh, Van Huynh, Tin, Luu, Son T., Nguyen, Ngan Luu-Thuy
One of the emerging research trends in natural language understanding is machine reading comprehension (MRC) which is the task to find answers to human questions based on textual data. Existing Vietnamese datasets for MRC research concentrate solely on answerable questions. However, in reality, questions can be unanswerable for which the correct answer is not stated in the given textual data. To address the weakness, we provide the research community with a benchmark dataset named UIT-ViQuAD 2.0 for evaluating the MRC task and question answering systems for the Vietnamese language. We use UIT-ViQuAD 2.0 as a benchmark dataset for the challenge on Vietnamese MRC at the Eighth Workshop on Vietnamese Language and Speech Processing (VLSP 2021). This task attracted 77 participant teams from 34 universities and other organizations. In this article, we present details of the organization of the challenge, an overview of the methods employed by shared-task participants, and the results. The highest performances are 77.24% in F1-score and 67.43% in Exact Match on the private test set. The Vietnamese MRC systems proposed by the top 3 teams use XLM-RoBERTa, a powerful pre-trained language model based on the transformer architecture. The UIT-ViQuAD 2.0 dataset motivates researchers to further explore the Vietnamese machine reading comprehension task and related tasks such as question answering, question generation, and natural language inference.
Ukraine begins using facial recognition to identify Russians and dead
Ukraine's defense ministry on Saturday began using Clearview AI's facial recognition technology, the company's chief executive said after the US startup offered to uncover Russian assailants, combat misinformation, and identify the dead. Ukraine is receiving free access to Clearview AI's powerful search engine for faces, letting authorities potentially vet people of interest at checkpoints, among other uses, added Lee Wolosky, an adviser to Clearview and former diplomat under US presidents Barack Obama and Joe Biden. The plans started forming after Russia invaded Ukraine and Clearview Chief Executive Hoan Ton-That sent a letter to Kyiv offering assistance, according to a copy seen by Reuters. Clearview said it had not offered the technology to Russia, which calls its actions in Ukraine a "special operation". Ukraine's Ministry of Defense did not reply to requests for comment.
Beyond Smoothness: Incorporating Low-Rank Analysis into Nonparametric Density Estimation
Vandermeulen, Robert A., Ledent, Antoine
The construction and theoretical analysis of the most popular universally consistent nonparametric density estimators hinge on one functional property: smoothness. In this paper we investigate the theoretical implications of incorporating a multi-view latent variable model, a type of low-rank model, into nonparametric density estimation. To do this we perform extensive analysis on histogram-style estimators that integrate a multi-view model. Our analysis culminates in showing that there exists a universally consistent histogram-style estimator that converges to any multi-view model with a finite number of Lipschitz continuous components at a rate of $\widetilde{O}(1/\sqrt[3]{n})$ in $L^1$ error. In contrast, the standard histogram estimator can converge at a rate slower than $1/\sqrt[d]{n}$ on the same class of densities. We also introduce a new nonparametric latent variable model based on the Tucker decomposition. A rudimentary implementation of our estimators experimentally demonstrates a considerable performance improvement over the standard histogram estimator. We also provide a thorough analysis of the sample complexity of our Tucker decomposition-based model and a variety of other results. Thus, our paper provides solid theoretical foundations for extending low-rank techniques to the nonparametric setting
100 of the world's among most noteworthy artificial intelligence companies are here (1)
The following is the "100 most noteworthy artificial intelligence companies" compiled by the AI generation (tencentAI) (in alphabetical order by company name): Inspired by recent discoveries about the way the brain processes information, Cortical.io's Retina engine converts language into semantic fingerprints, and then compares the semantic relatedness of any two texts by comparing the degree of overlap of the fingerprints. CrowdFlower is a human intervention training platform for data science teams that helps clients generate high-quality custom training data. The CrowdFlower platform supports a range of use cases including self-driving cars, personal assistants, medical image tagging, content classification, social data analysis, CRM data improvement, product classification and search relevance, and more. Headquartered in San Francisco, CrowdFlower's clients include Fortune 500 and data-driven companies.