South America
Assessing Algorithmic Fairness with Unobserved Protected Class Using Data Combination
Kallus, Nathan, Mao, Xiaojie, Zhou, Angela
The increasing impact of algorithmic decisions on people's lives compels us to scrutinize their fairness and, in particular, the disparate impacts that ostensibly-color-blind algorithms can have on different groups. Examples include credit decisioning, hiring, advertising, criminal justice, personalized medicine, and targeted policymaking, where in some cases legislative or regulatory frameworks for fairness exist and define specific protected classes. In this paper we study a fundamental challenge to assessing disparate impacts in practice: protected class membership is often not observed in the data. This is particularly a problem in lending and healthcare. We consider the use of an auxiliary dataset, such as the US census, that includes class labels but not decisions or outcomes. We show that a variety of common disparity measures are generally unidentifiable aside for some unrealistic cases, providing a new perspective on the documented biases of popular proxy-based methods. We provide exact characterizations of the sharpest-possible partial identification set of disparities either under no assumptions or when we incorporate mild smoothness constraints. We further provide optimization-based algorithms for computing and visualizing these sets, which enables reliable and robust assessments -- an important tool when disparity assessment can have far-reaching policy implications. We demonstrate this in two case studies with real data: mortgage lending and personalized medicine dosing.
FAN: Focused Attention Networks
Wang, Chu, Samari, Babak, Kim, Vladimir, Chaudhuri, Siddhartha, Siddiqi, Kaleem
Attention networks show promise for both vision and language tasks, by emphasizing relationships between constituent elements through appropriate weighting functions. Such elements could be regions in an image output by a region proposal network, or words in a sentence, represented by word embedding. Thus far, however, the learning of attention weights has been driven solely by the minimization of task specific loss functions. We here introduce a method of learning attention weights to better emphasize informative pair-wise relations between entities. The key idea is to use a novel center-mass cross entropy loss, which can be applied in conjunction with the task specific ones. We then introduce a focused attention backbone to learn these attention weights for general tasks. We demonstrate that the focused attention module leads to a new state-of-the-art for the recovery of relations in a relationship proposal task. Our experiments show that it also boosts performance for diverse vision and language tasks, including object detection, scene categorization and document classification.
Reinforcement Learning for Slate-based Recommender Systems: A Tractable Decomposition and Practical Methodology
Ie, Eugene, Jain, Vihan, Wang, Jing, Narvekar, Sanmit, Agarwal, Ritesh, Wu, Rui, Cheng, Heng-Tze, Lustman, Morgane, Gatto, Vince, Covington, Paul, McFadden, Jim, Chandra, Tushar, Boutilier, Craig
Recommender systems have become ubiquitous, transforming user interactions with products, services and content in a wide variety of domains. In content recommendation, recommenders generally surface relevant and/or novel personalized content based on learned models of user preferences (e.g., as in collaborative filtering [Breese et al., 1998, Konstan et al., 1997, Srebro et al., 2004, Salakhutdinov and Mnih, 2007]) or predictive models of user responses to specific recommendations. Well-known applications of recommender systems include video recommendations on YouTube [Covington et al., 2016], movie recommendations on Netflix [Gomez-Uribe and Hunt, 2016] and playlist construction on Spotify [Jacobson et al., 2016]. It is increasingly common to train deep neural networks (DNNs) [van den Oord et al., 2013, Wang et al., 2015, Covington et al., 2016, Cheng et al., 2016] to predict user responses (e.g., click-through rates, content engagement, ratings, likes) to generate, score and serve candidate recommendations. Practical recommender systems largely focus on myopic prediction--estimating a user's immediate response to a recommendation--without considering the long-term impact on subsequent user behavior. This can be limiting: modeling a recommendation's stochastic impact on the future affords opportunities to trade off user engagement in the near-term for longer-term benefit (e.g., by probing a user's interests, or improving satisfaction).
Ordinal Regression as Structured Classification
Twomey, Niall, Poyiadzi, Rafael, Mann, Callum, Santos-Rodríguez, Raúl
This paper extends the class of ordinal regression models with a structured interpretation of the problem by applying a novel treatment of encoded labels. The net effect of this is to transform the underlying problem from an ordinal regression task to a (structured) classification task which we solve with conditional random fields, thereby achieving a coherent and probabilistic model in which all model parameters are jointly learnt. Importantly, we show that although we have cast ordinal regression to classification, our method still fall within the class of decomposition methods in the ordinal regression ontology. This is an important link since our experience is that many applications of machine learning to healthcare ignores completely the important nature of the label ordering, and hence these approaches should considered naive in this ontology. We also show that our model is flexible both in how it adapts to data manifolds and in terms of the operations that are available for practitioner to execute. Our empirical evaluation demonstrates that the proposed approach overwhelmingly produces superior and often statistically significant results over baseline approaches on forty popular ordinal regression models, and demonstrate that the proposed model significantly out-performs baselines on synthetic and real datasets. Our implementation, together with scripts to reproduce the results of this work, will be available on a public GitHub repository.
Foundations of Digital Arch{\ae}oludology
Browne, Cameron, Soemers, Dennis J. N. J., Piette, Éric, Stephenson, Matthew, Conrad, Michael, Crist, Walter, Depaulis, Thierry, Duggan, Eddie, Horn, Fred, Kelk, Steven, Lucas, Simon M., Neto, João Pedro, Parlett, David, Saffidine, Abdallah, Schädler, Ulrich, Silva, Jorge Nuno, de Voogt, Alex, Winands, Mark H. M.
Digital Archaeoludology (DAL) is a new field of study involving the analysis and reconstruction of ancient games from incomplete descriptions and archaeological evidence using modern computational techniques. The aim is to provide digital tools and methods to help game historians and other researchers better understand traditional games, their development throughout recorded human history, and their relationship to the development of human culture and mathematical knowledge. This work is being explored in the ERC-funded Digital Ludeme Project. The aim of this inaugural international research meeting on DAL is to gather together leading experts in relevant disciplines - computer science, artificial intelligence, machine learning, computational phylogenetics, mathematics, history, archaeology, anthropology, etc. - to discuss the key themes and establish the foundations for this new field of research, so that it may continue beyond the lifetime of its initiating project.
The Ancient Rites That Gave Birth to Religion - Issue 72: Quandary
The invention of religion is a big bang in human history. Gods and spirits helped explain the unexplainable, and religious belief gave meaning and purpose to people struggling to survive. But what if everything we thought we knew about religion was wrong? What if belief in the supernatural is window dressing on what really matters--elaborate rituals that foster group cohesion, creating personal bonds that people are willing to die for. Anthropologist Harvey Whitehouse thinks too much talk about religion is based on loose conjecture and simplistic explanations. Whitehouse directs the Institute of Cognitive and Evolutionary Anthropology at Oxford University. For years he's been collaborating with scholars around the world to build a massive body of data that grounds the study of religion in science. Whitehouse draws on an array of disciplines--archeology, ethnography, history, evolutionary psychology, cognitive science--to construct a profile of religious practices. Whitehouse's fascination with religion goes back to his own groundbreaking field study of traditional beliefs in Papua New Guinea in the 1980s.
Is your CRM strategy advanced enough for artificial intelligence?
In his latest novel, Machines Like Me, Ian McEwan reimagines what 1980s Britain might have looked like if certain iconic events had swung a different way: Argentina winning the Falklands war; Margaret Thatcher battling Tony Benn for power. And then there's the catalyst for the book – what might have happened if Alan Turing had achieved a major breakthrough in the field of artificial intelligence. As with most visions of AI's future – or hypothetical past – the author speculates a dystopia in which sentient, anthropomorphous robots are embedded into our everyday lives. The pros and cons of AI are debated at an ethical and moral level; with less credence given to the practicality or the technological constraints. Whilst undoubtedly a necessity for a science fiction novel, in the real world, this lack of practical consideration for AI and the related constraints has been responsible for a huge amount of hyperbole in the enterprise technology market; especially in relation to CRM.
Data Complexity and Rewritability of Ontology-Mediated Queries in Metric Temporal Logic under the Event-Based Semantics (Full Version)
Ryzhikov, Vladislav, Walega, Przemyslaw Andrzej, Zakharyaschev, Michael
We investigate the data complexity of answering queries mediated by metric temporal logic ontologies under the event-based semantics assuming that data instances are finite timed words timestamped with binary fractions. We identify classes of ontology-mediated queries answering which can be done in AC0, NC1, L, NL, P, and coNP for data complexity, provide their rewritings to first-order logic and its extensions with primitive recursion, transitive closure or datalog, and establish lower complexity bounds.
Neural Consciousness Flow
Xu, Xiaoran, Feng, Wei, Sun, Zhiqing, Deng, Zhi-Hong
The ability of reasoning beyond data fitting is substantial to deep learning systems in order to make a leap forward towards artificial general intelligence. A lot of efforts have been made to model neural-based reasoning as an iterative decision-making process based on recurrent networks and reinforcement learning. Instead, inspired by the consciousness prior proposed by Yoshua Bengio, we explore reasoning with the notion of attentive awareness from a cognitive perspective, and formulate it in the form of attentive message passing on graphs, called neural consciousness flow (NeuCFlow). Aiming to bridge the gap between deep learning systems and reasoning, we propose an attentive computation framework with a three-layer architecture, which consists of an unconsciousness flow layer, a consciousness flow layer, and an attention flow layer. We implement the NeuCFlow model with graph neural networks (GNNs) and conditional transition matrices. Our attentive computation greatly reduces the complexity of vanilla GNN-based methods, capable of running on large-scale graphs. We validate our model for knowledge graph reasoning by solving a series of knowledge base completion (KBC) tasks. The experimental results show NeuCFlow significantly outperforms previous state-of-the-art KBC methods, including the embedding-based and the path-based. The reproducible code can be found by the link below.
Got Any Time-Travel Plans This Summer?
The last few years have seen an uptick in pop culture stories featuring time travel, from the repetitions and revisions of "The Good Place" and "Russian Doll" to developments in "Game of Thrones," "Star Trek: Discovery" and "Avengers: Endgame." Sometimes the MacGuffin by which we get to play with anachronism, but often also rooted in questions of free will and determinism, time travel is a fascinating springboard for fiction: Are there many futures, or just one? Can you change the past without changing the future, or yourself? This column brings together books about time fractured and out of joint, time as an unbroken lineage resisting empire, and time travel glimpsed through the overlapping lenses of psychology, philosophy and physics. Kameron Hurley's THE LIGHT BRIGADE (Saga, $26.99) is based on her 2015 short story of the same name, fleshing out the high-concept skeleton of a story about soldiers who are literally broken into light in order to teleport them to different theaters of war.