Oceania
Artificial Intelligence: UK's Supreme Court to rule on letting robots patent inventions
The UK's highest court is set to decide whether artificial intelligence (AI) robots should be allowed to patent their own inventions. Britain's Supreme Court has agreed to hear a computer scientist's bid to list his AI machine as the sole inventor of two separate products, in an application to the UK's patent office. The Supreme Court will hear Dr Stephen Thaler's bid to overturn an earlier ruling from a lower court, banning him from filing a patent application on behalf of his DABUS robot. The case comes after the UK's intellectual property office refused two patent applications, filed by Thaler on behalf of his DABUS system, over his failure to identify a "person" as the inventor of the products. Thaler had sought to file one patent for a "Food Container" and another for a flashing light, under the title "Devices and Methods for Attracting Enhanced Attention," in 2018.
Neural-Symbolic Models for Logical Queries on Knowledge Graphs
Zhu, Zhaocheng, Galkin, Mikhail, Zhang, Zuobai, Tang, Jian
Answering complex first-order logic (FOL) queries on knowledge graphs is a fundamental task for multi-hop reasoning. Traditional symbolic methods traverse a complete knowledge graph to extract the answers, which provides good interpretation for each step. Recent neural methods learn geometric embeddings for complex queries. These methods can generalize to incomplete knowledge graphs, but their reasoning process is hard to interpret. In this paper, we propose Graph Neural Network Query Executor (GNN-QE), a neural-symbolic model that enjoys the advantages of both worlds. GNN-QE decomposes a complex FOL query into relation projections and logical operations over fuzzy sets, which provides interpretability for intermediate variables. To reason about the missing links, GNN-QE adapts a graph neural network from knowledge graph completion to execute the relation projections, and models the logical operations with product fuzzy logic. Experiments on 3 datasets show that GNN-QE significantly improves over previous state-of-the-art models in answering FOL queries. Meanwhile, GNN-QE can predict the number of answers without explicit supervision, and provide visualizations for intermediate variables.
Interpretable Uncertainty Quantification in AI for HEP
Chen, Thomas Y., Dey, Biprateep, Ghosh, Aishik, Kagan, Michael, Nord, Brian, Ramachandra, Nesar
Estimating uncertainty is at the core of performing scientific measurements in HEP: a measurement is not useful without an estimate of its uncertainty. The goal of uncertainty quantification (UQ) is inextricably linked to the question, "how do we physically and statistically interpret these uncertainties?" The answer to this question depends not only on the computational task we aim to undertake, but also on the methods we use for that task. For artificial intelligence (AI) applications in HEP, there are several areas where interpretable methods for UQ are essential, including inference, simulation, and control/decision-making. There exist some methods for each of these areas, but they have not yet been demonstrated to be as trustworthy as more traditional approaches currently employed in physics (e.g., non-AI frequentist and Bayesian methods). Shedding light on the questions above requires additional understanding of the interplay of AI systems and uncertainty quantification. We briefly discuss the existing methods in each area and relate them to tasks across HEP. We then discuss recommendations for avenues to pursue to develop the necessary techniques for reliable widespread usage of AI with UQ over the next decade.
Personalized Game Difficulty Prediction Using Factorization Machines
Kristensen, Jeppe Theiss, Guckelsberger, Christian, Burelli, Paolo, Hämäläinen, Perttu
The accurate and personalized estimation of task difficulty provides many opportunities for optimizing user experience. However, user diversity makes such difficulty estimation hard, in that empirical measurements from some user sample do not necessarily generalize to others. In this paper, we contribute a new approach for personalized difficulty estimation of game levels, borrowing methods from content recommendation. Using factorization machines (FM) on a large dataset from a commercial puzzle game, we are able to predict difficulty as the number of attempts a player requires to pass future game levels, based on observed attempt counts from earlier levels and levels played by others. In addition to performance and scalability, FMs offer the benefit that the learned latent variable model can be used to study the characteristics of both players and game levels that contribute to difficulty. We compare the approach to a simple non-personalized baseline and a personalized prediction using Random Forests. Our results suggest that FMs are a promising tool enabling game designers to both optimize player experience and learn more about their players and the game.
Monolingual alignment of word senses and definitions in lexicographical resources
The focus of this thesis is broadly on the alignment of lexicographical data, particularly dictionaries. In order to tackle some of the challenges in this field, two main tasks of word sense alignment and translation inference are addressed. The first task aims to find an optimal alignment given the sense definitions of a headword in two different monolingual dictionaries. This is a challenging task, especially due to differences in sense granularity, coverage and description in two resources. After describing the characteristics of various lexical semantic resources, we introduce a benchmark containing 17 datasets of 15 languages where monolingual word senses and definitions are manually annotated across different resources by experts. In the creation of the benchmark, lexicographers' knowledge is incorporated through the annotations where a semantic relation, namely exact, narrower, broader, related or none, is selected for each sense pair. This benchmark can be used for evaluation purposes of word-sense alignment systems. The performance of a few alignment techniques based on textual and non-textual semantic similarity detection and semantic relation induction is evaluated using the benchmark. Finally, we extend this work to translation inference where translation pairs are induced to generate bilingual lexicons in an unsupervised way using various approaches based on graph analysis. This task is of particular interest for the creation of lexicographical resources for less-resourced and under-represented languages and also, assists in increasing coverage of the existing resources. From a practical point of view, the techniques and methods that are developed in this thesis are implemented within a tool that can facilitate the alignment task.
Improving Self-supervised Learning for Out-of-distribution Task via Auxiliary Classifier
Boonlia, Harshita, Dam, Tanmoy, Ferdaus, Md Meftahul, Anavatti, Sreenatha G., Mullick, Ankan
In real world scenarios, out-of-distribution (OOD) datasets may have a large distributional shift from training datasets. This phenomena generally occurs when a trained classifier is deployed on varying dynamic environments, which causes a significant drop in performance. To tackle this issue, we are proposing an end-to-end deep multi-task network in this work. Observing a strong relationship between rotation prediction (self-supervised) accuracy and semantic classification accuracy on OOD tasks, we introduce an additional auxiliary classification head in our multi-task network along with semantic classification and rotation prediction head. To observe the influence of this addition classifier in improving the rotation prediction head, our proposed learning method is framed into bi-level optimisation problem where the upper-level is trained to update the parameters for semantic classification and rotation prediction head. In the lower-level optimisation, only the auxiliary classification head is updated through semantic classification head by fixing the parameters of the semantic classification head. The proposed method has been validated through three unseen OOD datasets where it exhibits a clear improvement in semantic classification accuracy than other two baseline methods. Our code is available on GitHub \url{https://github.com/harshita-555/OSSL}
Algebraic and machine learning approach to hierarchical triple-star stability
Vynatheya, Pavan, Hamers, Adrian S., Mardling, Rosemary A., Bellinger, Earl P.
We present two approaches to determine the dynamical stability of a hierarchical triple-star system. The first is an improvement on the Mardling-Aarseth stability formula from 2001, where we introduce a dependence on inner orbital eccentricity and improve the dependence on mutual orbital inclination. The second involves a machine learning approach, where we use a multilayer perceptron (MLP) to classify triple-star systems as `stable' and `unstable'. To achieve this, we generate a large training data set of 10^6 hierarchical triples using the N-body code MSTAR. Both our approaches perform better than previous stability criteria, with the MLP model performing the best. The improved stability formula and the machine learning model have overall classification accuracies of 93 % and 95 % respectively. Our MLP model, which accurately predicts the stability of any hierarchical triple-star system within the parameter ranges studied with almost no computation required, is publicly available on Github in the form of an easy-to-use Python script.
Dynamic Semantic Occupancy Mapping using 3D Scene Flow and Closed-Form Bayesian Inference
Unnikrishnan, Aishwarya, Wilson, Joey, Gan, Lu, Capodieci, Andrew, Jayakumar, Paramsothy, Barton, Kira, Ghaffari, Maani
Semantic mapping complements geometric modelling of a Mapping, localization and navigation are among the key robot's surroundings with semantic concepts, i.e., an understanding capabilities of autonomous systems. For robots to navigate of what the environment means to the robot. With safely in complex and evolving environments, mapping semantic mapping, these semantic concepts manifest as a can act as a unified framework that addresses multiple representation of the environment, thus lending robots more perception sub-tasks required for a higher-level scene understanding, resources for task planning and execution. The emergence of such as occupancy/traversability estimation, object semantic mapping can be attributed to (i) the limitations of detection and tracking. While some research streams employ purely geometric maps, and (ii) the advancements in deep end-to-end deep neural networks for mapless navigation via neural networks that allow semantic interpretation of raw imitation [1], [2], reinforcement [3], [4] or self-supervised sensory data [6].
Change Detection for Local Explainability in Evolving Data Streams
Haug, Johannes, Braun, Alexander, Zürn, Stefan, Kasneci, Gjergji
As complex machine learning models are increasingly used in sensitive applications like banking, trading or credit scoring, there is a growing demand for reliable explanation mechanisms. Local feature attribution methods have become a popular technique for post-hoc and model-agnostic explanations. However, attribution methods typically assume a stationary environment in which the predictive model has been trained and remains stable. As a result, it is often unclear how local attributions behave in realistic, constantly evolving settings such as streaming and online applications. In this paper, we discuss the impact of temporal change on local feature attributions. In particular, we show that local attributions can become obsolete each time the predictive model is updated or concept drift alters the data generating distribution. Consequently, local feature attributions in data streams provide high explanatory power only when combined with a mechanism that allows us to detect and respond to local changes over time. To this end, we present CDLEEDS, a flexible and model-agnostic framework for detecting local change and concept drift. CDLEEDS serves as an intuitive extension of attribution-based explanation techniques to identify outdated local attributions and enable more targeted recalculations. In experiments, we also show that the proposed framework can reliably detect both local and global concept drift. Accordingly, our work contributes to a more meaningful and robust explainability in online machine learning.
Handcrafted Feature Selection Techniques for Pattern Recognition: A Survey
da Silva, Alysson Ribeiro, Silveira, Camila Guedes
The accuracy of a classifier, when performing Pattern recognition, is mostly tied to the quality and representativeness of the input feature vector. Feature Selection is a process that allows for representing information properly and may increase the accuracy of a classifier. This process is responsible for finding the best possible features, thus allowing us to identify to which class a pattern belongs. Feature selection methods can be categorized as Filters, Wrappers, and Embed. This paper presents a survey on some Filters and Wrapper methods for handcrafted feature selection. Some discussions, with regard to the data structure, processing time, and ability to well represent a feature vector, are also provided in order to explicitly show how appropriate some methods are in order to perform feature selection. Therefore, the presented feature selection methods can be accurate and efficient if applied considering their positives and negatives, finding which one fits best the problem's domain may be the hardest task.