Goto

Collaborating Authors

 Oceania


Autonomous vehicles get 'X-ray' vision to detect hidden obstacles

Daily Mail - Science & tech

New technology is giving autonomous vehicles'X-ray' vision to help them track pedestrians, cyclists and other vehicles that may be obscured. Experts in Australia are now commercialising the technology, which is called cooperative or collective perception (CP). It involves the installation of roadside information-sharing units ('ITS stations') equipped with sensors such as cameras and lidar. At a busy junction, for example, vehicles would use these units to share what they'see' with other vehicles. This gives each vehicle X-ray style vision that sees through buses to notice pedestrians, or a fast-moving van around a corner that's about to run a red light.


Machine Learning (ML) Business Use Cases 2021

#artificialintelligence

As machine learning (ML) technology improves and uses cases grow, more companies are employing ML to optimize their operations through data. As a branch of artificial intelligence (AI), ML is helping companies to make data-based predictions and decisions based at scale. The AES Corporation is a power generation and distribution company. They generate and sell power used for utilities and industrial work. They rely on Google Cloud on their road to making renewable energy more efficient.


Learning to Combine Per-Example Solutions for Neural Program Synthesis

arXiv.org Artificial Intelligence

The goal of program synthesis from examples is to find a computer program that is consistent with a given set of input-output examples. Most learning-based approaches try to find a program that satisfies all examples at once. Our work, by contrast, considers an approach that breaks the problem into two stages: (a) find programs that satisfy only one example, and (b) leverage these per-example solutions to yield a program that satisfies all examples. We introduce the Cross Aggregator neural network module based on a multi-head attention mechanism that learns to combine the cues present in these per-example solutions to synthesize a global solution. Evaluation across programs of different lengths and under two different experimental settings reveal that when given the same time budget, our technique significantly improves the success rate over PCCoder [32] and other ablation baselines.


Mixture Proportion Estimation and PU Learning: A Modern Approach

arXiv.org Machine Learning

Given only positive examples and unlabeled examples (from both positive and negative classes), we might hope nevertheless to estimate an accurate positive-versus-negative classifier. Formally, this task is broken down into two subtasks: (i) Mixture Proportion Estimation (MPE) -- determining the fraction of positive examples in the unlabeled data; and (ii) PU-learning -- given such an estimate, learning the desired positive-versus-negative classifier. Unfortunately, classical methods for both problems break down in high-dimensional settings. Meanwhile, recently proposed heuristics lack theoretical coherence and depend precariously on hyperparameter tuning. In this paper, we propose two simple techniques: Best Bin Estimation (BBE) (for MPE); and Conditional Value Ignoring Risk (CVIR), a simple objective for PU-learning. Both methods dominate previous approaches empirically, and for BBE, we establish formal guarantees that hold whenever we can train a model to cleanly separate out a small subset of positive examples. Our final algorithm (TED)$^n$, alternates between the two procedures, significantly improving both our mixture proportion estimator and classifier


On the Current and Emerging Challenges of Developing Fair and Ethical AI Solutions in Financial Services

arXiv.org Artificial Intelligence

Artificial intelligence (AI) continues to find more numerous and more critical applications in the financial services industry, giving rise to fair and ethical AI as an industry-wide objective. While many ethical principles and guidelines have been published in recent years, they fall short of addressing the serious challenges that model developers face when building ethical AI solutions. We survey the practical and overarching issues surrounding model development, from design and implementation complexities, to the shortage of tools, and the lack of organizational constructs. We show how practical considerations reveal the gaps between high-level principles and concrete, deployed AI applications, with the aim of starting industry-wide conversations toward solution approaches.


Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey

arXiv.org Artificial Intelligence

Large, pre-trained transformer-based language models such as BERT have drastically changed the Natural Language Processing (NLP) field. We present a survey of recent work that uses these large language models to solve NLP tasks via pre-training then fine-tuning, prompting, or text generation approaches. We also present approaches that use pre-trained language models to generate data for training augmentation or other purposes. We conclude with discussions on limitations and suggested directions for future research.


When Does Contrastive Learning Preserve Adversarial Robustness from Pretraining to Finetuning?

arXiv.org Artificial Intelligence

Contrastive learning (CL) can learn generalizable feature representations and achieve the state-of-the-art performance of downstream tasks by finetuning a linear classifier on top of it. However, as adversarial robustness becomes vital in image classification, it remains unclear whether or not CL is able to preserve robustness to downstream tasks. The main challenge is that in the self-supervised pretraining + supervised finetuning paradigm, adversarial robustness is easily forgotten due to a learning task mismatch from pretraining to finetuning. We call such a challenge 'cross-task robustness transferability'. To address the above problem, in this paper we revisit and advance CL principles through the lens of robustness enhancement. We show that (1) the design of contrastive views matters: High-frequency components of images are beneficial to improving model robustness; (2) Augmenting CL with pseudo-supervision stimulus (e.g., resorting to feature clustering) helps preserve robustness without forgetting. Equipped with our new designs, we propose AdvCL, a novel adversarial contrastive pretraining framework. We show that AdvCL is able to enhance cross-task robustness transferability without loss of model accuracy and finetuning efficiency. With a thorough experimental study, we demonstrate that AdvCL outperforms the state-of-the-art self-supervised robust learning methods across multiple datasets (CIFAR-10, CIFAR-100, and STL-10) and finetuning schemes (linear evaluation and full model finetuning).


Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and Stir"

arXiv.org Artificial Intelligence

There is a growing consensus in HCI and AI research that the design of AI systems needs to engage and empower stakeholders who will be affected by AI. However, the manner in which stakeholders should participate in AI design is unclear. This workshop paper aims to ground what we dub a 'participatory turn' in AI design by synthesizing existing literature on participation and through empirical analysis of its current practices via a survey of recent published research and a dozen semi-structured interviews with AI researchers and practitioners. Based on our literature synthesis and empirical research, this paper presents a conceptual framework for analyzing participatory approaches to AI design and articulates a set of empirical findings that in ensemble detail out the contemporary landscape of participatory practice in AI design. These findings can help bootstrap a more principled discussion on how PD of AI should move forward across AI, HCI, and other research communities.


Artificial intelligence for Earth observation: monitoring of wildfires - eo science for society

#artificialintelligence

Wildfires are a natural component of the Earth system, important for nutrient release and vegetation growth. Climate change, however, is contributing to more frequent, more destructive and less predictable wildfires worldwide. Australia, in particular, experiences regular bush fires during the summer, but the devastating 2019-2020 bushfire season, known as the Black Summer, was unprecedented in its severity and scale, killing dozens of people and destroying thousands of homes. Quantifying and monitoring fires is fundamental to mitigate their negative impact on the environment and society, but also for the ongoing climate studies, as wildfires have a significant influence on global atmospheric emissions and climate change. The increasing availability of Earth Observation (EO) data combined with the advanced analytics provided by Artificial Intelligence (AI) and Machine Learning (ML), along with the exceptional processing power of cloud computing, has allowed the AI4EO wildfire project, led by CGI UK, to generate a service that can map fires at an unprecedented level of detail and also provide fast, reliable and accessible information as required by the wildfire fighting community.


Classifying YouTube Comments Based on Sentiment and Type of Sentence

arXiv.org Artificial Intelligence

As a YouTube channel grows, each video can potentially collect enormous amounts of comments that provide direct feedback from the viewers. These comments are a major means of understanding viewer expectations and improving channel engagement. However, the comments only represent a general collection of user opinions about the channel and the content. Many comments are poorly constructed, trivial, and have improper spellings and grammatical errors. As a result, it is a tedious job to identify the comments that best interest the content creators. In this paper, we extract and classify the raw comments into different categories based on both sentiment and sentence types that will help YouTubers find relevant comments for growing their viewership. Existing studies have focused either on sentiment analysis (positive and negative) or classification of sub-types within the same sentence types (e.g., types of questions) on a text corpus. These have limited application on non-traditional text corpus like YouTube comments. We address this challenge of text extraction and classification from YouTube comments using well-known statistical measures and machine learning models. We evaluate each combination of statistical measure and the machine learning model using cross validation and $F_1$ scores. The results show that our approach that incorporates conventional methods performs well on the classification task, validating its potential in assisting content creators increase viewer engagement on their channel.