Oceania
Deep Learning Models for Early Detection and Prediction of the spread of Novel Coronavirus (COVID-19)
Ayris, Devante, Horbury, Kye, Williams, Blake, Blackney, Mitchell, See, Celine Shi Hui, Shah, Syed Afaq Ali
SARS-CoV2, which causes coronavirus disease (COVID-19) is continuing to spread globally and has become a pandemic. People have lost their lives due to the virus and the lack of counter measures in place. Given the increasing caseload and uncertainty of spread, there is an urgent need to develop machine learning techniques to predict the spread of COVID-19. Prediction of the spread can allow counter measures and actions to be implemented to mitigate the spread of COVID-19. In this paper, we propose a deep learning technique, called Deep Sequential Prediction Model (DSPM) and machine learning based Non-parametric Regression Model (NRM) to predict the spread of COVID-19. Our proposed models were trained and tested on novel coronavirus 2019 dataset, which contains 19.53 Million confirmed cases of COVID-19. Our proposed models were evaluated by using Mean Absolute Error and compared with baseline method. Our experimental results, both quantitative and qualitative, demonstrate the superior prediction performance of the proposed models.
Western News - Machine learning predicts satisfaction in romantic relationships
The most reliable predictor of a relationship's success is partners' belief that the other person is fully committed, a Western University-led international research team has found. Other important factors in a successful relationship include feeling close to, appreciated by and sexually satisfied with your partner, says the study – the first-ever systematic attempt at using machine-learning algorithms to predict people's relationship satisfaction. "Satisfaction with romantic relationships has important implications for health, wellbeing and work productivity," Western Psychology professor Samantha Joel said. "But research on predictors of relationship quality is often limited in scope and scale, and carried out separately in individual laboratories." The massive machine-learning study, conducted by Joel, Paul Eastwick from University of California, Davis, and 84 other scholars from around the world, delved into more than 11,000 couples and 43 distinct self-reported datasets on romantic couples.
Improving Generative Adversarial Networks with Local Coordinate Coding
Cao, Jiezhang, Guo, Yong, Wu, Qingyao, Shen, Chunhua, Huang, Junzhou, Tan, Mingkui
Generative adversarial networks (GANs) have shown remarkable success in generating realistic data from some predefined prior distribution (e.g., Gaussian noises). However, such prior distribution is often independent of real data and thus may lose semantic information (e.g., geometric structure or content in images) of data. In practice, the semantic information might be represented by some latent distribution learned from data. However, such latent distribution may incur difficulties in data sampling for GANs. In this paper, rather than sampling from the predefined prior distribution, we propose an LCCGAN model with local coordinate coding (LCC) to improve the performance of generating data. First, we propose an LCC sampling method in LCCGAN to sample meaningful points from the latent manifold. With the LCC sampling method, we can exploit the local information on the latent manifold and thus produce new data with promising quality. Second, we propose an improved version, namely LCCGAN++, by introducing a higher-order term in the generator approximation. This term is able to achieve better approximation and thus further improve the performance. More critically, we derive the generalization bound for both LCCGAN and LCCGAN++ and prove that a low-dimensional input is sufficient to achieve good generalization performance. Extensive experiments on four benchmark datasets demonstrate the superiority of the proposed method over existing GANs.
Lifelong Incremental Reinforcement Learning with Online Bayesian Inference
Wang, Zhi, Chen, Chunlin, Dong, Daoyi
A central capability of a long-lived reinforcement learning (RL) agent is to incrementally adapt its behavior as its environment changes, and to incrementally build upon previous experiences to facilitate future learning in real-world scenarios. In this paper, we propose LifeLong Incremental Reinforcement Learning (LLIRL), a new incremental algorithm for efficient lifelong adaptation to dynamic environments. We develop and maintain a library that contains an infinite mixture of parameterized environment models, which is equivalent to clustering environment parameters in a latent space. The prior distribution over the mixture is formulated as a Chinese restaurant process (CRP), which incrementally instantiates new environment models without any external information to signal environmental changes in advance. During lifelong learning, we employ the expectation maximization (EM) algorithm with online Bayesian inference to update the mixture in a fully incremental manner. In EM, the E-step involves estimating the posterior expectation of environment-to-cluster assignments, while the M-step updates the environment parameters for future learning. This method allows for all environment models to be adapted as necessary, with new models instantiated for environmental changes and old models retrieved when previously seen environments are encountered again. Experiments demonstrate that LLIRL outperforms relevant existing methods, and enables effective incremental adaptation to various dynamic environments for lifelong learning.
Deep learning models for representing out-of-vocabulary words
Lochter, Johannes V., Silva, Renato M., Almeida, Tiago A.
Communication has become increasingly dynamic with the popularization of social networks and applications that allow people to express themselves and communicate instantly. In this scenario, distributed representation models have their quality impacted by new words that appear frequently or that are derived from spelling errors. These words that are unknown by the models, known as out-of-vocabulary (OOV) words, need to be properly handled to not degrade the quality of the natural language processing (NLP) applications, which depend on the appropriate vector representation of the texts. To better understand this problem and finding the best techniques to handle OOV words, in this study, we present a comprehensive performance evaluation of deep learning models for representing OOV words. We performed an intrinsic evaluation using a benchmark dataset and an extrinsic evaluation using different NLP tasks: text categorization, named entity recognition, and part-of-speech tagging. Although the results indicated that the best technique for handling OOV words is different for each task, Comick, a deep learning method that infers the embedding based on the context and the morphological structure of the OOV word, obtained promising results.
A Comparison of Optimization Algorithms for Deep Learning
In recent years, we have witnessed the rise of deep learning. Deep neural networks have proved their success in many areas. However, the optimization of these networks has become more difficult as neural networks going deeper and datasets becoming bigger. Therefore, more advanced optimization algorithms have been proposed over the past years. In this study, widely used optimization algorithms for deep learning are examined in detail. To this end, these algorithms called adaptive gradient methods are implemented for both supervised and unsupervised tasks. The behaviour of the algorithms during training and results on four image datasets, namely, MNIST, CIFAR-10, Kaggle Flowers and Labeled Faces in the Wild are compared by pointing out their differences against basic optimization algorithms.
Reachable Sets of Classifiers & Regression Models: (Non-)Robustness Analysis and Robust Training
Kopetzki, Anna-Kathrin, Günnemann, Stephan
Neural networks achieve outstanding accuracy in classification and regression tasks. However, understanding their behavior still remains an open challenge that requires questions to be addressed on the robustness, explainability and reliability of predictions. We answer these questions by computing reachable sets of neural networks, i.e. sets of outputs resulting from continuous sets of inputs. We provide two efficient approaches that lead to over- and under-approximations of the reachable set. This principle is highly versatile, as we show. First, we analyze and enhance the robustness properties of both classifiers and regression models. This is in contrast to existing works, which only handle classification. Specifically, we verify (non-)robustness, propose a robust training procedure, and show that our approach outperforms adversarial attacks as well as state-of-the-art methods of verifying classifiers for non-norm bound perturbations. We also provide a technique of distinguishing between reliable and non-reliable predictions for unlabeled inputs, quantify the influence of each feature on a prediction, and compute a feature ranking.
Explaining the data or explaining a model? Shapley values that uncover non-linear dependencies
Fryer, Daniel Vidali, Strümke, Inga, Nguyen, Hien
Shapley values have become increasingly popular in the machine learning literature thanks to their attractive axiomatisation, flexibility, and uniqueness in satisfying certain notions of `fairness'. The flexibility arises from the myriad potential forms of the Shapley value \textit{game formulation}. Amongst the consequences of this flexibility is that there are now many types of Shapley values being discussed, with such variety being a source of potential misunderstanding. To the best of our knowledge, all existing game formulations in the machine learning and statistics literature fall into a category which we name the model-dependent category of game formulations. In this work, we consider an alternative and novel formulation which leads to the first instance of what we call model-independent Shapley values. These Shapley values use a (non-parametric) measure of non-linear dependence as the characteristic function. The strength of these Shapley values is in their ability to uncover and attribute non-linear dependencies amongst features. We introduce and demonstrate the use of the energy distance correlations, affine-invariant distance correlation, and Hilbert-Shmidt independence criterion as Shapley value characteristic functions. In particular, we demonstrate their potential value for exploratory data analysis and model diagnostics. We conclude with an interesting expository application to a classical medical survey data set.
Coaching in 2030: How Artificial Intelligence Will Change Our Profession - SimpliFaster
Simply put, for the last 200 years, advisers have worked on the principle of information asymmetry, where they have better information than their clients. Today, we are at the point where machine intelligence is gaining information asymmetry over advisers, and that's only going to get more acute and asymmetrical as time goes on. The only possible hope for human advisers is that they co-opt machine intelligence into their process.
Machine learning predicts satisfaction in romantic relationships
The most reliable predictor of a relationship's success is partners' belief that the other person is fully committed, a Western University-led international research team has found. Other important factors in a successful relationship include feeling close to, appreciated by and sexually satisfied with your partner, says the study – the first-ever systematic attempt at using machine-learning algorithms to predict people's relationship satisfaction. "Satisfaction with romantic relationships has important implications for health, wellbeing and work productivity," Western Psychology professor Samantha Joel said. "But research on predictors of relationship quality is often limited in scope and scale, and carried out separately in individual laboratories." The massive machine-learning study, conducted by Joel, Paul Eastwick from University of California, Davis, and 84 other scholars from around the world, delved into more than 11,000 couples and 43 distinct self-reported datasets on romantic couples.