Oceania
Artificial Intelligence Study of Human Genome Finds Unknown Human Ancestor
Can the minds of machines teach us something new about what it means to be human? When it comes to the intricate story of our species' complex origins and evolution, it appears that they can. A recent study used machine learning technology to analyze eight leading models of human origins and evolution, and the program identified evidence in the human genome of a "ghost population" of human ancestors. The analysis suggests that a previously unknown and long-extinct group of hominins interbred with Homo sapiens in Asia and Oceania somewhere along the long, winding road of human evolutionary history, leaving behind only fragmented traces in modern human DNA. The study, published in Nature Communications, is one of the first examples of how machine learning can help reveal clues to our own origins.
Machine learning heats up the contest for human talent
"Graduates at IBM are coming into roles where you provide services to a range of different industries as opposed to just working in one," she says. "From a career perspective, they can move across different industries but they also move across different functions. You retain your core expertise but you also get to do different jobs because of the diversity of our clients." IBM works with dozens of Australia's biggest companies using Watson to drive machine learning and data analysis within business, and has the advantage of being able to supply whole teams of experts as challenges arise. In contrast, even big industry employers often have only a few specialists in key areas.
Yes, we GAN: Applying Adversarial Techniques for Autonomous Driving
Uricar, Michal, Krizek, Pavel, Hurych, David, Sobh, Ibrahim, Yogamani, Senthil, Denny, Patrick
Generative Adversarial Networks (GAN) have gained a lot of popularity from their introduction in 2014 till present. Research on GAN is rapidly growing and there are many variants of the original GAN focusing on various aspects of deep learning. GAN are perceived as the most impactful direction of machine learning in the last decade. This paper focuses on the application of GAN in autonomous driving including topics such as advanced data augmentation, loss function learning, semi-supervised learning, etc. We formalize and review key applications of adversarial techniques and discuss challenges and open problems to be addressed.
Pure Exploration with Multiple Correct Answers
Degenne, Rรฉmy, Koolen, Wouter M.
We determine the sample complexity of pure exploration bandit problems with multiple good answers. We derive a lower bound using a new game equilibrium argument. We show how continuity and convexity properties of single-answer problems ensures that the Track-and-Stop algorithm has asymptotically optimal sample complexity. However, that convexity is lost when going to the multiple-answer setting. We present a new algorithm which extends Track-and-Stop to the multiple-answer case and has asymptotic sample complexity matching the lower bound.
Passing Tests without Memorizing: Two Models for Fooling Discriminators
Bousquet, Olivier, Livni, Roi, Moran, Shay
We introduce two mathematical frameworks for foolability in the context of generative distribution learning. In a nuthsell, fooling is an algorithmic task in which the input sample is drawn from some target distribution and the goal is to output a synthetic distribution that is indistinguishable from the target w.r.t to some fixed class of tests. This framework received considerable attention in the context of Generative Adversarial Networks (GANs), a recently proposed approach which achieves impressive empirical results. From a theoretical viewpoint this problem seems difficult to model. This is due to the fact that in its basic form, the notion of foolability is susceptible to a type of overfitting called memorizing. This raises a challenge of devising notions and definitions that separate between fooling algorithms that generate new synthetic data vs. algorithms that merely memorize or copy the training set. The first model we consider is called GAM--Foolability and is inspired by GANs. Here the learner has only an indirect access to the target distribution via a discriminator. The second model, called DP--Foolability, exploits the notion of differential privacy as a candidate criterion for non-memorization. We proceed to characterize foolability within these two models and study their interrelations. We show that DP--Foolability implies GAM--Foolability and prove partial results with respect to the converse. It remains, though, an open question whether GAM--Foolability implies DP--Foolability. We also present an application in the context of differentially private PAC learning. We show that from a statistical perspective, for any class H, learnability by a private proper learner is equivalent to the existence of a private sanitizer for H. This can be seen as an analogue of the equivalence between uniform convergence and learnability in classical PAC learning.
Sydney Machine Learning (Sydney, Australia)
PLEASE NOTE: that RSVPing to this page DOES NOT GRANT YOU ACCESS to this meetup, Spaces are limited! DESCRIPTION How do we design Ai systems that we trust? Algorithmic Bias, Algorithmic Transparency, Technological Unemployment, Data Privacy & Algorithmic Misinformation (fake news) are just some of the issues facing the fair and ethical use of Machine Learning. In collaboration with Microsoft for this DSAi special edition Ethics & Interpretability event - come along to learn from industry leaders how issues such as Algorithmic Bias might affect you & what is being done to address the ethical use of Machine Learning in 2019. 'Ethics for Artificial Intelligence' In this 20 minute presentation, Aurelie will provide a formal introduction as to what ethical and responsible AI is.
Binarized Knowledge Graph Embeddings
Kishimoto, Koki, Hayashi, Katsuhiko, Akai, Genki, Shimbo, Masashi, Komatani, Kazunori
Tensor factorization has become an increasingly popular approach to knowledge graph completion(KGC), which is the task of automatically predicting missing facts in a knowledge graph. However, even with a simple model like CANDECOMP/PARAFAC(CP) tensor decomposition, KGC on existing knowledge graphs is impractical in resource-limited environments, as a large amount of memory is required to store parameters represented as 32-bit or 64-bit floating point numbers. This limitation is expected to become more stringent as existing knowledge graphs, which are already huge, keep steadily growing in scale. To reduce the memory requirement, we present a method for binarizing the parameters of the CP tensor decomposition by introducing a quantization function to the optimization problem. This method replaces floating point-valued parameters with binary ones after training, which drastically reduces the model size at run time. We investigate the trade-off between the quality and size of tensor factorization models for several KGC benchmark datasets. In our experiments, the proposed method successfully reduced the model size by more than an order of magnitude while maintaining the task performance. Moreover, a fast score computation technique can be developed with bitwise operations.
Size Independent Neural Transfer for RDDL Planning
Garg, Sankalp, Bajpai, Aniket, Mausam, null
Neural planners for RDDL MDPs produce deep reactive policies in an offline fashion. These scale well with large domains, but are sample inefficient and time-consuming to train from scratch for each new problem. To mitigate this, recent work has studied neural transfer learning, so that a generic planner trained on other problems of the same domain can rapidly transfer to a new problem. However, this approach only transfers across problems of the same size. We present the first method for neural transfer of RDDL MDPs that can transfer across problems of different sizes. Our architecture has two key innovations to achieve size independence: (1) a state encoder, which outputs a fixed length state embedding by max pooling over varying number of object embeddings, (2) a single parameter-tied action decoder that projects object embeddings into action probabilities for the final policy. On the two challenging RDDL domains of SysAdmin and Game Of Life, our approach powerfully transfers across problem sizes and has superior learning curves over training from scratch.
A Bayesian Deep Learning Framework for End-To-End Prediction of Emotion from Heartbeat
Harper, Ross, Southern, Joshua
Automatic prediction of emotion promises to revolutionise human-computer interaction. Recent trends involve fusion of multiple modalities - audio, visual, and physiological - to classify emotional state. However, practical considerations 'in the wild' limit collection of this physiological data to commoditised heartbeat sensors. Furthermore, real-world applications often require some measure of uncertainty over model output. We present here an end-to-end deep learning model for classifying emotional valence from unimodal heartbeat data. We further propose a Bayesian framework for modelling uncertainty over valence predictions, and describe a procedure for tuning output according to varying demands on confidence. We benchmarked our framework against two established datasets within the field and achieved peak classification accuracy of 90%. These results lay the foundation for applications of affective computing in real-world domains such as healthcare, where a high premium is placed on non-invasive collection of data, and predictive certainty.
Cost-Based Goal Recognition in Navigational Domains
Masters, Peta, Sardina, Sebastian
Goal recognition is the problem of determining an agent's intent by observing her behaviour. Contemporary solutions for general task-planning relate the probability of a goal to the cost of reaching it. We adapt this approach to goal recognition in the strict context of path-planning. We show (1) that a simpler formula provides an identical result to current state-of-the-art in less than half the time under all but one set of conditions. Further, we prove (2) that the probability distribution based on this technique is independent of an agent's past behaviour and present a revised formula that achieves goal recognition by reference to the agent's starting point and current location only. Building on this, we demonstrate (3) that a Radius of Maximum Probability (i.e., the distance from a goal within which that goal is guaranteed to be the most probable) can be calculated from relative cost-distances between the candidate goals and a start location, without needing to calculate any actual probabilities. In this extended version of earlier work, we generalise our framework to the continuous domain and discuss our results, including the conditions under which our findings can be generalised back to goal recognition in general task-planning.