Oceania
Robot kayaks found the basin of an Alaskan glacier is melting 100 TIMES faster than models showed
Seaborne robots have made a startling discovery beneath a 20-mile glacier in Alaska. The technology found the massive rivers of ice may be melting under the LeConte Glacier much faster than previously thought. Scientists programmed autonomous kayaks to swim near the icy cliffs of the glacier to measure the'ambient meltwater intrusions', which shows how much fresh water is flowing into the ocean from underneath the glacier. The study found ambient melting was 100 times higher than models had estimated. This is the first time experts have been able to analyze plumes of meltwater - the water released when snow or ice melts, where glaciers meet the ocean- because the feat is far too dangerous for ships due to falling ice of slabs from the glacier.
Assessing Google CEO Sundar Pichai's call for fair AI regulations
Google CEO Sundar Pichai and other executives working on artificial intelligence are now calling for limited government regulation as the European Union mulls potential five-year bans of facial recognition software. Pichai called for governments to take a bigger role in regulating the use of artificial intelligence (AI), and he published his beliefs in a Financial Times editorial while speaking out on the topic in speeches around the world. This is in stark opposition to comments he made in an interview with the Financial Times in September that called for caution with any potential government intrusion of how tech companies deploy AI. "There are real concerns about the potential negative consequences of AI, from deepfakes to nefarious uses of facial recognition. While there is already some work being done to address these concerns, there will inevitably be more challenges ahead that no one company or industry can solve alone," Pichai wrote in The Financial Times. "The EU and the US are already starting to develop regulatory proposals. International alignment will be critical to making global standards work. To get there, we need agreement on core values. Companies such as ours cannot just build promising new technology and let market forces decide how it will be used. It is equally incumbent on us to make sure that technology is harnessed for good and available to everyone," he said in the editorial.
SA vs SAA for population Wasserstein barycenter calculation
In Machine Learning and Optimization community there are two main approaches for convex risk minimization problem. The first approach is Stochastic Averaging (SA) (online) and the second one is Stochastic Average Approximation (SAA) (Monte Carlo, Empirical Risk Minimization, offline) with proper regularization in non-strongly convex case. At the moment, it is known that both approaches are on average equivalent (up to a logarithmic factor) in terms of oracle complexity (required number of stochastic gradient evaluations). What is the situation with total complexity? The answer depends on specific problem. However, starting from work [Nemirovski et al. (2009)] it was generally accepted that SA is better than SAA. Nevertheless, in case of large-scale problems SA may ran out of memory problems since storing all data on one machine and organizing online access to it can be impossible without communications with other machines. SAA in contradistinction to SA allows parallel/distributed calculations. In this paper we show that SAA may outperform SA in the problem of calculating an estimation for population ({\mu}-entropy regularized) Wasserstein barycenter even for non-parallel (non-decenralized) set up.
Deep Learning Based Unsupervised and Semi-supervised Classification for Keratoconus
Hallett, Nicole, Yi, Kai, Dick, Josef, Hodge, Christopher, Sutton, Gerard, Wang, Yu Guang, You, Jingjing
The transparent cornea is the window of the eye, facilitating the entry of light rays and controlling focusing the movement of the light within the eye. The cornea is critical, contributing to 75% of the refractive power of the eye. Keratoconus is a progressive and multifactorial corneal degenerative disease affecting 1 in 2000 individuals worldwide. Currently, there is no cure for keratoconus other than corneal transplantation for advanced stage keratoconus or corneal cross-linking, which can only halt KC progression. The ability to accurately identify subtle KC or KC progression is of vital clinical significance. To date, there has been little consensus on a useful model to classify KC patients, which therefore inhibits the ability to predict disease progression accurately. In this paper, we utilised machine learning to analyse data from 124 KC patients, including topographical and clinical variables. Both supervised multilayer perceptron and unsupervised variational autoencoder models were used to classify KC patients with reference to the existing Amsler-Krumeich (A-K) classification system. Both methods result in high accuracy, with the unsupervised method showing better performance. The result showed that the unsupervised method with a selection of 29 variables could be a powerful tool to provide an automatic classification tool for clinicians. These outcomes provide a platform for additional analysis for the progression and treatment of keratoconus.
Are Pre-trained Language Models Aware of Phrases? Simple but Strong Baselines for Grammar Induction
Kim, Taeuk, Choi, Jihun, Edmiston, Daniel, Lee, Sang-goo
With the recent success and popularity of pre-trained language models (LMs) in natural language processing, there has been a rise in efforts to understand their inner workings. In line with such interest, we propose a novel method that assists us in investigating the extent to which pre-trained LMs capture the syntactic notion of constituency. Our method provides an effective way of extracting constituency trees from the pre-trained LMs without training. In addition, we report intriguing findings in the induced trees, including the fact that some pre-trained LMs outperform other approaches in correctly demarcating adverb phrases in sentences.
Quaternion-Valued Recurrent Projection Neural Networks on Unit Quaternions
Valle, Marcos Eduardo, Lobo, Rodolfo Anibal
Hypercomplex-valued neural networks, including quaternion-valued neural networks, can treat multidimensional data as a single entity. In this paper, we present the quaternion-valued recurrent projection neural networks (QRPNNs). Briefly, QRPNNs are obtained by combining the non-local projection learning with the quaternion-valued recurrent correlation neural network (QRCNNs). We show that QRPNNs overcome the crosstalk problem of QRCNNs. Thus, they are appropriate to implement associative memories. Furthermore, computational experiments reveal that QRPNNs exhibit greater storage capacity and noise tolerance than their corresponding QRCNNs. Introduction The Hopfield neural network, developed in the early 1980s, is an important and widely-known recurrent neural network which can be used to implement associative memories [1, 2]. Successful applications of the Hopfield network include control [3, 4], computer vision and image processing [5, 6], classification [7, 8], and optimization [2, 9, 10]. Despite its many successful applications, the Hopfield network may suffer from a very low storage capacity when used to implement associative memories. Precisely, due to crosstalk between the stored items, the Hebbian learning adopted by Hopfield in his original work allows for the storage of approximately n/(2 ln n) items, where n denotes the length of the stored vectors [11]. For example, Personnaz et al. [12] as well as Kanter and Sompolinsky [13] proposed the projection rule to determine the synaptic weights of the Hopfield networks. The projection rule increases the storage capacity of the Hopfield network to n 1 items. Another simple but effective improvement on the storage capacity of the original Hopfield networks was achieved by Chiueh and Goodman's recurrent correlation neural networks (RCNNs) [14, 15]. Briefly, an RCNN is obtained by decomposing the Hopfield network with Hebbian learning into a two layer recurrent neural network.
CosmoVAE: Variational Autoencoder for CMB Image Inpainting
Yi, Kai, Guo, Yi, Fan, Yanan, Hamann, Jan, Wang, Yu Guang
Cosmic microwave background radiation (CMB) is critical to the understanding of the early universe and precise estimation of cosmological constants. Due to the contamination of thermal dust noise in the galaxy, the CMB map that is an image on the two-dimensional sphere has missing observations, mainly concentrated on the equatorial region. The noise of the CMB map has a significant impact on the estimation precision for cosmological parameters. Inpainting the CMB map can effectively reduce the uncertainty of parametric estimation. In this paper, we propose a deep learning-based variational autoencoder --- CosmoVAE, to restoring the missing observations of the CMB map. The input and output of CosmoVAE are square images. To generate training, validation, and test data sets, we segment the full-sky CMB map into many small images by Cartesian projection. CosmoVAE assigns physical quantities to the parameters of the VAE network by using the angular power spectrum of the Gaussian random field as latent variables. CosmoVAE adopts a new loss function to improve the learning performance of the model, which consists of $\ell_1$ reconstruction loss, Kullback-Leibler divergence between the posterior distribution of encoder network and the prior distribution of latent variables, perceptual loss, and total-variation regularizer. The proposed model achieves state of the art performance for Planck \texttt{Commander} 2018 CMB map inpainting.
Better Multi-class Probability Estimates for Small Data Sets
Alasalmi, Tuomo, Suutala, Jaakko, Koskimäki, Heli, Röning, Juha
Many classification applications require accurate probability estimates in addition to good class separation but often classifiers are designed focusing only on the latter. Calibration is the process of improving probability estimates by post-processing but commonly used calibration algorithms work poorly on small data sets and assume the classification task to be binary. Both of these restrictions limit their real-world applicability. Previously introduced Data Generation and Grouping algorithm alleviates the problem posed by small data sets and in this article, we will demonstrate that its application to multi-class problems is also possible which solves the other limitation. Our experiments show that calibration error can be decreased using the proposed approach and the additional computational cost is acceptable.
Survey of Deep Reinforcement Learning for Motion Planning of Autonomous Vehicles
Academic research in the field of autonomous vehicles has reached high popularity in recent years related to several topics as sensor technologies, V2X communications, safety, security, decision making, control, and even legal and standardization rules. Besides classic control design approaches, Artificial Intelligence and Machine Learning methods are present in almost all of these fields. Another part of research focuses on different layers of Motion Planning, such as strategic decisions, trajectory planning, and control. A wide range of techniques in Machine Learning itself have been developed, and this article describes one of these fields, Deep Reinforcement Learning (DRL). The paper provides insight into the hierarchical motion planning problem and describes the basics of DRL. The main elements of designing such a system are the modeling of the environment, the modeling abstractions, the description of the state and the perception models, the appropriate rewarding, and the realization of the underlying neural network. The paper describes vehicle models, simulation possibilities and computational requirements. Strategic decisions on different layers and the observation models, e.g., continuous and discrete state representations, grid-based, and camera-based solutions are presented. The paper surveys the state-of-art solutions systematized by the different tasks and levels of autonomous driving, such as car-following, lane-keeping, trajectory following, merging, or driving in dense traffic. Finally, open questions and future challenges are discussed.
#302: Robots That Can See, Do, and Win, with Juxi Leitner
Juxi Leitner is co-founder of LYRO Robotics, a deep-tech startup based in Brisbane, Australia, creating robotic picking and packing solutions. LYRO is a spin-out of the Australian Centre of Excellence for Robotic Vision (ACRV), where Juxi is the research lead for the manipulation research stream (previously Vision and Action project). His research focus is on integrating Robotics, Computer Vision and Machine Learning/Artificial Intelligence (AI) for robust grasping and manipulation in real-world scenarios. In 2017 his team won the Amazon Robotics Challenge. Juxi is active in the local Brisbane deep-tech ecosystem and started Brisbane.AI and the Brisbane robotics interest group.