Law
Wer ist schuld, wenn Algorithmen irren? Entscheidungsautomatisierung, Organisationen und Verantwortung
Adensamer, Angelika, Gsenger, Rita, Klausner, Lukas Daniel
Algorithmic decision support (ADS) is increasingly used in a whole array of different contexts and structures in various areas of society, influencing many people's lives. Its use raises questions, among others, about accountability, transparency and responsibility. Our article aims to give a brief overview of the central issues connected to ADS, responsibility and decision-making in organisational contexts and identify open questions and research gaps. Furthermore, we describe a set of guidelines and a complementary digital tool to assist practitioners in mapping responsibility when introducing ADS within their organisational context.
Combining Intra-Risk and Contagion Risk for Enterprise Bankruptcy Prediction Using Graph Neural Networks
Zhao, Yu, Wei, Shaopeng, Guo, Yu, Yang, Qing, Chen, Xingyan, Li, Qing, Zhuang, Fuzhen, Liu, Ji, Kou, Gang
Predicting the bankruptcy risk of small and medium-sized enterprises (SMEs) is an important step for financial institutions when making decisions about loans. Existing studies in both finance and AI research fields, however, tend to only consider either the intra-risk or contagion risk of enterprises, ignoring their interactions and combinatorial effects. This study for the first time considers both types of risk and their joint effects in bankruptcy prediction. Specifically, we first propose an enterprise intra-risk encoder based on statistically significant enterprise risk indicators for its intra-risk learning. Then, we propose an enterprise contagion risk encoder based on enterprise relation information from an enterprise knowledge graph for its contagion risk embedding. In particular, the contagion risk encoder includes both the newly proposed Hyper-Graph Neural Networks and Heterogeneous Graph Neural Networks, which can model contagion risk in two different aspects, i.e. common risk factors based on hyperedges and direct diffusion risk from neighbors, respectively. To evaluate the model, we collect real-world multi-sources data on SMEs and build a novel benchmark dataset called SMEsD. We provide open access to the dataset, which is expected to further promote research on financial risk analysis. Experiments on SMEsD against twelve state-of-the-art baselines demonstrate the effectiveness of the proposed model for bankruptcy prediction.
Causal Machine Learning: A Survey and Open Problems
Kaddour, Jean, Lynch, Aengus, Liu, Qi, Kusner, Matt J., Silva, Ricardo
Causal Machine Learning (CausalML) is an umbrella term for machine learning methods that formalize the data-generation process as a structural causal model (SCM). This perspective enables us to reason about the effects of changes to this process (interventions) and what would have happened in hindsight (counterfactuals). We categorize work in CausalML into five groups according to the problems they address: (1) causal supervised learning, (2) causal generative modeling, (3) causal explanations, (4) causal fairness, and (5) causal reinforcement learning. We systematically compare the methods in each category and point out open problems. Further, we review data-modality-specific applications in computer vision, natural language processing, and graph representation learning. Finally, we provide an overview of causal benchmarks and a critical discussion of the state of this nascent field, including recommendations for future work.
The Impact of AI on Healthcare: How to Make the Models Work?
Research into Artificial Intelligence (AI) has been ongoing for decades, with early proposals dating back to 1950. However, only in recent years, it has seen a resurgence in popularity thanks to the increased availability of computing power and the growth of big data and machine learning. AI is the ability of machines to perform tasks that ordinarily require human intelligence, such as understanding natural language and recognizing objects. With the rapid expansion of AI, there are opportunities for businesses and individuals alike to capitalize on its capabilities. AI is a field of computer science and engineering focused on the creation of intelligent agents, which are systems that can reason, learn, and act autonomously.
Senior Data Engineer (Research)
The AI & Research team at CallMiner is tackling some of the toughest problems in speech analytics with AI - deciphering human conversations. We do this using "Conversational AI" - a blend of NLP, ML, and statistical ingenuity. The goal of the team is to augment the leading Speech Analytics product suite in the industry, Callminer Eureka. The challenge of unlocking business intelligence from billions of examples of human speech requires a multidisciplinary approach, and the best candidates have proven experience in applying ML, technology, and business strategy to discover key insights that lie hidden within our customer's data sets. This role bridges the gap between Software Engineer and Data & Research Scientist and will focus on creating, processing, storing, and refining data features for use in ML approaches relating to speech analytics.
Towards VEsNA, a Framework for Managing Virtual Environments via Natural Language Agents
Gatti, Andrea, Mascardi, Viviana
Automating a factory where robots are involved is neither trivial nor cheap. Engineering the factory automation process in such a way that return of interest is maximized and risk for workers and equipment is minimized, is hence of paramount importance. Simulation can be a game changer in this scenario but requires advanced programming skills that domain experts and industrial designers might not have. In this paper we present the preliminary design and implementation of a general-purpose framework for creating and exploiting Virtual Environments via Natural language Agents (VEsNA). VEsNA takes advantage of agent-based technologies and natural language processing to enhance the design of virtual environments. The natural language input provided to VEsNA is understood by a chatbot and passed to a cognitive intelligent agent that implements the logic behind displacing objects in the virtual environment. In the VEsNA vision, the intelligent agent will be able to reason on this displacement and on its compliance to legal and normative constraints. It will also be able to implement what-if analysis and case-based reasoning. Objects populating the virtual environment will include active objects and will populate a dynamic simulation whose outcomes will be interpreted by the cognitive agent; explanations and suggestions will be passed back to the user by the chatbot.
MANI-Rank: Multiple Attribute and Intersectional Group Fairness for Consensus Ranking
Cachel, Kathleen, Rundensteiner, Elke, Harrison, Lane
Combining the preferences of many rankers into one single consensus ranking is critical for consequential applications from hiring and admissions to lending. While group fairness has been extensively studied for classification, group fairness in rankings and in particular rank aggregation remains in its infancy. Recent work introduced the concept of fair rank aggregation for combining rankings but restricted to the case when candidates have a single binary protected attribute, i.e., they fall into two groups only. Yet it remains an open problem how to create a consensus ranking that represents the preferences of all rankers while ensuring fair treatment for candidates with multiple protected attributes such as gender, race, and nationality. In this work, we are the first to define and solve this open Multi-attribute Fair Consensus Ranking (MFCR) problem. As a foundation, we design novel group fairness criteria for rankings, called MANI-RANK, ensuring fair treatment of groups defined by individual protected attributes and their intersection. Leveraging the MANI-RANK criteria, we develop a series of algorithms that for the first time tackle the MFCR problem. Our experimental study with a rich variety of consensus scenarios demonstrates our MFCR methodology is the only approach to achieve both intersectional and protected attribute fairness while also representing the preferences expressed through many base rankings. Our real-world case study on merit scholarships illustrates the effectiveness of our MFCR methods to mitigate bias across multiple protected attributes and their intersections. This is an extended version of "MANI-Rank: Multiple Attribute and Intersectional Group Fairness for Consensus Ranking", to appear in ICDE 2022.
Measuring and signing fairness as performance under multiple stakeholder distributions
Lopez-Paz, David, Bouchacourt, Diane, Sagun, Levent, Usunier, Nicolas
As learning machines increase their influence on decisions concerning human lives, analyzing their fairness properties becomes a subject of central importance. Yet, our best tools for measuring the fairness of learning systems are rigid fairness metrics encapsulated as mathematical one-liners, offer limited power to the stakeholders involved in the prediction task, and are easy to manipulate when we exhort excessive pressure to optimize them. To advance these issues, we propose to shift focus from shaping fairness metrics to curating the distributions of examples under which these are computed. In particular, we posit that every claim about fairness should be immediately followed by the tagline "Fair under what examples, and collected by whom?". By highlighting connections to the literature in domain generalization, we propose to measure fairness as the ability of the system to generalize under multiple stress tests -- distributions of examples with social relevance. We encourage each stakeholder to curate one or multiple stress tests containing examples reflecting their (possibly conflicting) interests. The machine passes or fails each stress test by falling short of or exceeding a pre-defined metric value. The test results involve all stakeholders in a discussion about how to improve the learning system, and provide flexible assessments of fairness dependent on context and based on interpretable data. We provide full implementation guidelines for stress testing, illustrate both the benefits and shortcomings of this framework, and introduce a cryptographic scheme to enable a degree of prediction accountability from system providers.
AI Fairness: from Principles to Practice
Bateni, Arash, Chan, Matthew C., Eitel-Porter, Ray
This paper summarizes and evaluates various approaches, methods, and techniques for pursuing fairness in artificial intelligence (AI) systems. It examines the merits and shortcomings of these measures and proposes practical guidelines for defining, measuring, and preventing bias in AI. In particular, it cautions against some of the simplistic, yet common, methods for evaluating bias in AI systems, and offers more sophisticated and effective alternatives. The paper also addresses widespread controversies and confusions in the field by providing a common language among different stakeholders of high-impact AI systems. It describes various trade-offs involving AI fairness, and provides practical recommendations for balancing them. It offers techniques for evaluating the costs and benefits of fairness targets, and defines the role of human judgment in setting these targets. This paper provides discussions and guidelines for AI practitioners, organization leaders, and policymakers, as well as various links to additional materials for a more technical audience. Numerous real-world examples are provided to clarify the concepts, challenges, and recommendations from a practical perspective.
NSF Funds Machine-Learning Research at UNO and UNL to Study Energy Requirements of Walking in Older Adults
However, as we grow older, our bodies become less energy efficient, turning simple daily activities like walking around a block into a daunting effort. Although the effect of aging on the energetic costs of walking is well-documented, we do not yet have a complete understanding of what causes the progressive increase in energetic cost. One of the challenges to understanding this phenomenon is that current technologies for assessing metabolic energy consumption require measuring several minutes of breathing. These measurements are too slow to gain insight into the energetic cost of different phases of the gait cycle. The Disability and Rehabilitation Engineering program (DARE) and the Established Program to Stimulate Competitive Research (EPSCoR) from the National Science Foundation (NSF) are funding a collaborative project at the University of Nebraska at Omaha (UNO) and at the University of Nebraska at Lincoln (UNL) aimed at investigating the metabolic cost of different phases of the walking gait cycle. It is expected that this inter-campus collaboration between researchers from different disciplines will enable the development more creative solutions than single-discipline research.