Goto

Collaborating Authors

 Country


Deep Gamblers: Learning to Abstain with Portfolio Theory

arXiv.org Machine Learning

We deal with the \textit{selective classification} problem (supervised-learning problem with a rejection option), where we want to achieve the best performance at a certain level of coverage of the data. We transform the original $m$-class classification problem to $(m+1)$-class where the $(m+1)$-th class represents the model abstaining from making a prediction due to uncertainty. Inspired by portfolio theory, we propose a loss function for the selective classification problem based on the doubling rate of gambling. We show that minimizing this loss function has a natural interpretation as maximizing the return of a \textit{horse race}, where a player aims to balance between betting on an outcome (making a prediction) when confident and reserving one's winnings (abstaining) when not confident. This loss function allows us to train neural networks and characterize the uncertainty of prediction in an end-to-end fashion. In comparison with previous methods, our method requires almost no modification to the model inference algorithm or neural architecture. Experimentally, we show that our method can identify both uncertain and outlier data points, and achieves strong results on SVHN and CIFAR10 at various coverages of the data.


Privacy Risks of Explaining Machine Learning Models

arXiv.org Machine Learning

Can we trust black-box machine learning with its decisions? Can we trust algorithms to train machine learning models on sensitive data? Transparency and privacy are two fundamental elements of trust for adopting machine learning. In this paper, we investigate the relation between interpretability and privacy. In particular we analyze if an adversary can exploit transparent machine learning to infer sensitive information about its training set. To this end, we perform membership inference as well as reconstruction attacks on two popular classes of algorithms for explaining machine learning models: feature-based and record-based influence measures. We empirically show that an attacker, that only observes the feature-based explanations, has the same power as the state of the art membership inference attacks on model predictions. We also demonstrate that record-based explanations can be effectively exploited to reconstruct significant parts of the training set. Finally, our results indicate that minorities and special cases are more vulnerable to these type of attacks than majority groups.


Ludii and XCSP: Playing and Solving Logic Puzzles

arXiv.org Artificial Intelligence

Many of the famous single-player games, commonly called puzzles, can be shown to be NP-Complete. Indeed, this class of complexity contains hundreds of puzzles, since people particularly appreciate completing an intractable puzzle, such as Sudoku, but also enjoy the ability to check their solution easily once it's done. For this reason, using constraint programming is naturally suited to solve them. In this paper, we focus on logic puzzles described in the Ludii general game system and we propose using the XCSP formalism in order to solve them with any CSP solver.


An Empirical Evaluation of Two General Game Systems: Ludii and RBG

arXiv.org Artificial Intelligence

Although General Game Playing (GGP) systems can facilitate useful research in Artificial Intelligence (AI) for game-playing, they are often computationally inefficient and somewhat specialised to a specific class of games. However, since the start of this year, two General Game Systems have emerged that provide efficient alternatives to the academic state of the art -- the Game Description Language (GDL). In order of publication, these are the Regular Boardgames language (RBG), and the Ludii system. This paper offers an experimental evaluation of Ludii. Here, we focus mainly on a comparison between the two new systems in terms of two key properties for any GGP system: simplicity/clarity (e.g. human-readability), and efficiency.


An Overview of the Ludii General Game System

arXiv.org Artificial Intelligence

The Digital Ludeme Project (DLP) aims to reconstruct and analyse over 1000 traditional strategy games using modern techniques. One of the key aspects of this project is the development of Ludii, a general game system that will be able to model and play the complete range of games required by this project. Such an undertaking will create a wide range of possibilities for new AI challenges. In this paper we describe many of the features of Ludii that can be used. This includes designing and modifying games using the Ludii game description language, creating agents capable of playing these games, and several advantages the system has over prior general game software.


Causal Inference Under Interference And Network Uncertainty

arXiv.org Artificial Intelligence

Classical causal and statistical inference methods typically assume the observed data consists of independent realizations. However, in many applications this assumption is inappropriate due to a network of dependences between units in the data. Methods for estimating causal effects have been developed in the setting where the structure of dependence between units is known exactly, but in practice there is often substantial uncertainty about the precise network structure. This is true, for example, in trial data drawn from vulnerable communities where social ties are difficult to query directly. In this paper we combine techniques from the structure learning and interference literatures in causal inference, proposing a general method for estimating causal effects under data dependence when the structure of this dependence is not known a priori. We demonstrate the utility of our method on synthetic datasets which exhibit network dependence.


Formalized Conceptual Spaces with a Geometric Representation of Correlations

arXiv.org Artificial Intelligence

The highly influential framework of conceptual spaces provides a geometric way of representing knowledge. Instances are represented by points in a similarity space and concepts are represented by convex regions in this space. After pointing out a problem with the convexity requirement, we propose a formalization of conceptual spaces based on fuzzy star-shaped sets. Our formalization uses a parametric definition of concepts and extends the original framework by adding means to represent correlations between different domains in a geometric way. Moreover, we define various operations for our formalization, both for creating new concepts from old ones and for measuring relations between concepts. We present an illustrative toy-example and sketch a research project on concept formation that is based on both our formalization and its implementation.


Major Police Body Camera Manufacturer Rejects Facial Recognition Software

NPR Technology

A Los Angeles police officer wears an Axon body camera in 2017. On Thursday, the company announced it is holding off on facial recognition software, citing its unreliability. A Los Angeles police officer wears an Axon body camera in 2017. On Thursday, the company announced it is holding off on facial recognition software, citing its unreliability. The largest manufacturer of police body cameras is rejecting the possibility of selling facial recognition technology โ€“ at least, for now.


Algorithmic Intelligence Has Gotten So Smart, It's Easy To Forget It's Artificial

NPR Technology

Computers use algorithms to do everything from adding up a column of figures to resizing a window. Computers use algorithms to do everything from adding up a column of figures to resizing a window. Algorithms were around for a very long time before the public paid them any notice. The word itself is derived from the name of a 9th-century Persian mathematician, and the notion is simple enough: an algorithm is just any step-by-step procedure for accomplishing some task, from making the morning coffee to performing cardiac surgery. Computers use algorithms for pretty much everything they do -- adding up a column of figures, resizing a window, saving a file to disk.


The female game designers fighting back on abortion rights

The Guardian

You're part of an underground network of feminists in Chicago that provide illegal (at the time) abortion services to vulnerable, pregnant people with few options. Despite the risk of imprisonment, and the ways that your personal experiences may not always perfectly align with your activism, you persist. It's a live-action roleplaying game by Jon Cole and Kelley Vanda called The Abortionists, which requires three players, one facilitator, six hours and a willingness to dig deep into the painful history of reproductive rights in the United States. That history has terrifying relevance in 2019, as numerous states pass laws that put their residents in a reality where abortion is functionally illegal. Based on the real-life work of a 1970s activist group called Jane, it challenges its participants to think about the "internal landscapes" of its players, and how they deal with the larger political and personal landscape of their world.