Goto

Collaborating Authors

 Oceania


ASMFS: Adaptive-Similarity-based Multi-modality Feature Selection for Classification of Alzheimer's Disease

arXiv.org Artificial Intelligence

Multimodal classification methods using different modalities of imaging and non-imaging data have great advantages over traditional single-modality-based ones for the diagnosis and prognosis of Alzheimer's disease (AD), as well as mild cognitive impairment (MCI) which is the prodromal stage of AD. With the increasing amount of high-dimensional heterogeneous data to be processed, multi-modality feature selection has become a crucial research direction in medical image analysis. However, traditional methods usually depict the data structure using fixed and predefined similarity matrix as a priori, which is difficult to precisely measure the intrinsic relationship structure across different modalities in highdimensional spaces. In addition, based on the predefined similarity matrix, the chosen neighbors are suboptimal thus limiting the performance of the subsequent classification task. To overcome these drawbacks, in this paper, we propose a novel multi-modal feature selection method called Adaptive-Similarity-based Multi-modality Feature Selection (ASMFS) which performs adaptive similarity learning and feature selection simultaneously.


How many images do I need? Understanding how sample size per class affects deep learning model performance metrics for balanced designs in autonomous wildlife monitoring

arXiv.org Artificial Intelligence

Deep learning (DL) algorithms are the state of the art in automated classification of wildlife camera trap images. The challenge is that the ecologist cannot know in advance how many images per species they need to collect for model training in order to achieve their desired classification accuracy. In fact there is limited empirical evidence in the context of camera trapping to demonstrate that increasing sample size will lead to improved accuracy. In this study we explore in depth the issues of deep learning model performance for progressively increasing per class (species) sample sizes. We also provide ecologists with an approximation formula to estimate how many images per animal species they need for certain accuracy level a priori. This will help ecologists for optimal allocation of resources, work and efficient study design. In order to investigate the effect of number of training images; seven training sets with 10, 20, 50, 150, 500, 1000 images per class were designed. Six deep learning architectures namely ResNet-18, ResNet-50, ResNet-152, DnsNet-121, DnsNet-161, and DnsNet-201 were trained and tested on a common exclusive testing set of 250 images per class. The whole experiment was repeated on three similar datasets from Australia, Africa and North America and the results were compared. Simple regression equations for use by practitioners to approximate model performance metrics are provided. Generalized additive models (GAM) are shown to be effective in modelling DL performance metrics based on the number of training images per class, tuning scheme and dataset. Key-words: Camera Traps, Deep Learning, Ecological Informatics, Generalised Additive Models, Learning Curves, Predictive Modelling, Wildlife.


Anisotropic Stroke Control for Multiple Artists Style Transfer

arXiv.org Artificial Intelligence

Though significant progress has been made in artistic style transfer, semantic information is usually difficult to be preserved in a fine-grained locally consistent manner by most existing methods, especially when multiple artists styles are required to transfer within one single model. To circumvent this issue, we propose a Stroke Control Multi-Artist Style Transfer framework. On the one hand, we develop a multi-condition single-generator structure which first performs multi-artist style transfer. On the one hand, we design an Anisotropic Stroke Module (ASM) which realizes the dynamic adjustment of style-stroke between the non-trivial and the trivial regions. ASM endows the network with the ability of adaptive semantic-consistency among various styles. On the other hand, we present an novel Multi-Scale Projection Discriminator} to realize the texture-level conditional generation. In contrast to the single-scale conditional discriminator, our discriminator is able to capture multi-scale texture clue to effectively distinguish a wide range of artistic styles. Extensive experimental results well demonstrate the feasibility and effectiveness of our approach. Our framework can transform a photograph into different artistic style oil painting via only ONE single model. Furthermore, the results are with distinctive artistic style and retain the anisotropic semantic information.


A Strong Baseline for Weekly Time Series Forecasting

arXiv.org Artificial Intelligence

Many businesses and industries require accurate forecasts for weekly time series nowadays. The forecasting literature however does not currently provide easy-to-use, automatic, reproducible and accurate approaches dedicated to this task. We propose a forecasting method that can be used as a strong baseline in this domain, leveraging state-of-the-art forecasting techniques, forecast combination, and global modelling. Our approach uses four base forecasting models specifically suitable for forecasting weekly data: a global Recurrent Neural Network model, Theta, Trigonometric Box-Cox ARMA Trend Seasonal (TBATS), and Dynamic Harmonic Regression ARIMA (DHR-ARIMA). Those are then optimally combined using a lasso regression stacking approach. We evaluate the performance of our method against a set of state-of-the-art weekly forecasting models on six datasets. Across four evaluation metrics, we show that our method consistently outperforms the benchmark methods by a considerable margin with statistical significance. In particular, our model can produce the most accurate forecasts, in terms of mean sMAPE, for the M4 weekly dataset.


National Security Commission On AI Calls For Building India-US Strategic Tech Alliance

#artificialintelligence

In a recently released report, an independent federal commission on artificial intelligence -- National Security Commission on Artificial Intelligence mentioned that the US should build a formal tech alliance with India. This move has been called to help develop a comprehensive Indo-Pacific strategy that will be focused on emerging technologies. This newly-created US body in its report has clearly stated that the Department of State and the Department of Defence should negotiate formal cooperation agreements with countries like India, Australia, Japan, New Zealand, South Korea and Vietnam, with regards to artificial intelligence. The same report has been submitted to the Congress and President Donald Trump, where it has been underlined that the US must build on the strength of its allies and partners to win the global technology competition and preserve free and open societies. According to the Commission, it is required to grow support for the Quadrilateral Security Dialogue, which is a strategic forum among the US, Australia, India, and Japan, which will help in creating a formal relationship with nations in the Indo-Pacific region to concentrate on AI cooperation for defence and security purposes. The Commission further recommended that to achieve this goal, it is required to create a comprehensive strategic framework to marshal international multilateral and bilateral cooperation.


Council Post: How Innovative AI Solutions Can Help Combat Global Warming

#artificialintelligence

Ashok, CEO of UnfoldLabs, is an innovation veteran who believes in making the world a better place with futuristic technology products. Australian researchers have suggested a 2050 scenario of doomsday for humanity. Climate change is the biggest and toughest global problem humanity faces today. Global warming requires innovation from the brightest and the best. Our scientists have turned to artificial intelligence (AI) for the best possible solutions because it is easy to proactively predict and build models immediately.


OptiGAN: Generative Adversarial Networks for Goal Optimized Sequence Generation

arXiv.org Machine Learning

One of the challenging problems in sequence generation tasks is the optimized generation of sequences with specific desired goals. Current sequential generative models mainly generate sequences to closely mimic the training data, without direct optimization of desired goals or properties specific to the task. We introduce OptiGAN, a generative model that incorporates both Generative Adversarial Networks (GAN) and Reinforcement Learning (RL) to optimize desired goal scores using policy gradients. We apply our model to text and real-valued sequence generation, where our model is able to achieve higher desired scores out-performing GAN and RL baselines, while not sacrificing output sample diversity.


Holistic Combination of Structural and Textual Code Information for Context based API Recommendation

arXiv.org Artificial Intelligence

Context based API recommendation is an important way to help developers find the needed APIs effectively and efficiently. For effective API recommendation, we need not only a joint view of both structural and textual code information, but also a holistic view of correlated API usage in control and data flow graph as a whole. Unfortunately, existing API recommendation methods exploit structural or textual code information separately. In this work, we propose a novel API recommendation approach called APIRec-CST (API Recommendation by Combining Structural and Textual code information). APIRec-CST is a deep learning model that combines the API usage with the text information in the source code based on an API Context Graph Network and a Code Token Network that simultaneously learn structural and textual features for API recommendation. We apply APIRec-CST to train a model for JDK library based on 1,914 open-source Java projects and evaluate the accuracy and MRR (Mean Reciprocal Rank) of API recommendation with another 6 open-source projects. The results show that our approach achieves respectively a top-1, top-5, top-10 accuracy and MRR of 60.3%, 81.5%, 87.7% and 69.4%, and significantly outperforms an existing graph-based statistical approach and a tree-based deep learning approach for API recommendation. A further analysis shows that textual code information makes sense and improves the accuracy and MRR. We also conduct a user study in which two groups of students are asked to finish 6 programming tasks with or without our APIRec-CST plugin. The results show that APIRec-CST can help the students to finish the tasks faster and more accurately and the feedback on the usability is overwhelmingly positive.


Reliable Evaluations for Natural Language Inference based on a Unified Cross-dataset Benchmark

arXiv.org Artificial Intelligence

Recent studies show that crowd-sourced Natural Language Inference (NLI) datasets may suffer from significant biases like annotation artifacts. Models utilizing these superficial clues gain mirage advantages on the in-domain testing set, which makes the evaluation results over-estimated. The lack of trustworthy evaluation settings and benchmarks stalls the progress of NLI research. In this paper, we propose to assess a model's trustworthy generalization performance with cross-datasets evaluation. We present a new unified cross-datasets benchmark with 14 NLI datasets, and re-evaluate 9 widely-used neural network-based NLI models as well as 5 recently proposed debiasing methods for annotation artifacts. Our proposed evaluation scheme and experimental baselines could provide a basis to inspire future reliable NLI research.


Neural Topic Model via Optimal Transport

arXiv.org Machine Learning

Recently, Neural Topic Models (NTMs) inspired by variational autoencoders have obtained increasingly research interest due to their promising results on text analysis. However, it is usually hard for existing NTMs to achieve good document representation and coherent/diverse topics at the same time. Moreover, they often degrade their performance severely on short documents. The requirement of reparameterisation could also comprise their training quality and model flexibility. To address these shortcomings, we present a new neural topic model via the theory of optimal transport (OT). Specifically, we propose to learn the topic distribution of a document by directly minimising its OT distance to the document's word distributions. Importantly, the cost matrix of the OT distance models the weights between topics and words, which is constructed by the distances between topics and words in an embedding space. Our proposed model can be trained efficiently with a differentiable loss. Extensive experiments show that our framework significantly outperforms the state-of-the-art NTMs on discovering more coherent and diverse topics and deriving better document representations for both regular and short texts.