Statistical Learning
Robustness Implies Fairness in Causal Algorithmic Recourse
Ehyaei, Ahmad-Reza, Karimi, Amir-Hossein, Schölkopf, Bernhard, Maghsudi, Setareh
Algorithmic Recourse refers to the capability of an algorithm to provide explanations and make recommendations in response to an appeal or challenge raised by an individual who has been affected negatively by its decision Wachter et al. (2017); Ustun et al. (2019); Karimi et al. (2020); Venkatasubramanian and Alfano (2020). This concept is particularly important in areas such as finance, healthcare, and criminal justice where decisions made by algorithms can have significant impacts on people's lives Chou et al. (2022). Recently, there has been an explosion of proposals for counterfactual explainers in the emerging field of algorithmic recourse Guidotti (2022); Stepin et al. (2021); Karimi et al. (2021); Verma et al. (2020). Ensuring fairness and robustness in algorithmic decision-making processes is crucial to guarantee fair and just outcomes for all involved. In the context of algorithmic recourse, robustness refers to the ability of an algorithm to withstand unreliability, manipulation, or deception by malicious actors, while still providing fair and accurate recourse recommendations Slack et al. (2021); Upadhyay et al. (2021); Dominguez-Olmedo et al. (2022); Pawelczyk et al. (2022). There are four types of unreliabilities in counterfactual explanations Mishra et al. (2021): Robustness to input perturbations: Examining recourse behavior in response to slight input changes while the classifier remains unchanged Dominguez-Olmedo et al. (2022).
Interpretable Deep Learning for Forecasting Online Advertising Costs: Insights from the Competitive Bidding Landscape
Oldenburg, Fynn, Han, Qiwei, Kaiser, Maximilian
As advertisers increasingly shift their budgets toward digital advertising, forecasting advertising costs is essential for making budget plans to optimize marketing campaign returns. In this paper, we perform a comprehensive study using a variety of time-series forecasting methods to predict daily average cost-per-click (CPC) in the online advertising market. We show that forecasting advertising costs would benefit from multivariate models using covariates from competitors' CPC development identified through time-series clustering. We further interpret the results by analyzing feature importance and temporal attention. Finally, we show that our approach has several advantages over models that individual advertisers might build based solely on their collected data.
TPE-Net: Track Point Extraction and Association Network for Rail Path Proposal Generation
Kang, Jungwon, Ghorbanalivakili, Mohammadjavad, Sohn, Gunho, Beach, David, Marin, Veronica
One essential feature of an autonomous train is minimizing collision risks with third-party objects. To estimate the risk, the control system must identify topological information of all the rail routes ahead on which the train can possibly move, especially within merging or diverging rails. This way, the train can figure out the status of potential obstacles with respect to its route and hence, make a timely decision. Numerous studies have successfully extracted all rail tracks as a whole within forward-looking images without considering element instances. Still, some image-based methods have employed hard-coded prior knowledge of railway geometry on 3D data to associate left-right rails and generate rail route instances. However, we propose a rail path extraction pipeline in which left-right rail pixels of each rail route instance are extracted and associated through a fully convolutional encoder-decoder architecture called TPE-Net. Two different regression branches for TPE-Net are proposed to regress the locations of center points of each rail route, along with their corresponding left-right pixels. Extracted rail pixels are then spatially clustered to generate topological information of all the possible train routes (ego-paths), discarding non-ego-path ones. Experimental results on a challenging, publicly released benchmark show true-positive-pixel level average precision and recall of 0.9207 and 0.8721, respectively, at about 12 frames per second. Even though our evaluation results are not higher than the SOTA, the proposed regression pipeline performs remarkably in extracting the correspondences by looking once at the image. It generates strong rail route hypotheses without reliance on camera parameters, 3D data, and geometrical constraints.
Hybrid Feature- and Similarity-Based Models for Joint Prediction and Interpretation
Kueper, Jacqueline K., Rayner, Jennifer, Lizotte, Daniel J.
Electronic health records (EHRs) include simple features like patient age together with more complex data like care history that are informative but not easily represented as individual features. To better harness such data, we developed an interpretable hybrid feature- and similarity-based model for supervised learning that combines feature and kernel learning for prediction and for investigation of causal relationships. We fit our hybrid models by convex optimization with a sparsity-inducing penalty on the kernel. Depending on the desired model interpretation, the feature and kernel coefficients can be learned sequentially or simultaneously. The hybrid models showed comparable or better predictive performance than solely feature- or similarity-based approaches in a simulation study and in a case study to predict two-year risk of loneliness or social isolation with EHR data from a complex primary health care population. Using the case study we also present new kernels for high-dimensional indicator-coded EHR data that are based on deviations from population-level expectations, and we identify considerations for causal interpretations.
DiffDock: Diffusion Steps, Twists, and Turns for Molecular Docking
Corso, Gabriele, Stärk, Hannes, Jing, Bowen, Barzilay, Regina, Jaakkola, Tommi
Predicting the binding structure of a small molecule ligand to a protein--a task known as molecular docking--is critical to drug design. Recent deep learning methods that treat docking as a regression problem have decreased runtime compared to traditional search-based methods but have yet to offer substantial improvements in accuracy. To do so, we map this manifold to the product space of the degrees of freedom (translational, rotational, and torsional) involved in docking and develop an efficient diffusion process on this space. Moreover, while previous methods are not able to dock on computationally folded structures (maximum accuracy 10.4%), D The biological functions of proteins can be modulated by small molecule ligands (such as drugs) binding to them. Thus, a crucial task in computational drug design is molecular docking--predicting the position, orientation, and conformation of a ligand when bound to a target protein--from which the effect of the ligand (if any) might be ...
Dialectograms: Machine Learning Differences between Discursive Communities
Enggaard, Thyge, Lohse, August, Pedersen, Morten Axel, Lehmann, Sune
Word embeddings provide an unsupervised way to understand differences in word usage between discursive communities. A number of recent papers have focused on identifying words that are used differently by two or more communities. But word embeddings are complex, high-dimensional spaces and a focus on identifying differences only captures a fraction of their richness. Here, we take a step towards leveraging the richness of the full embedding space, by using word embeddings to map out how words are used differently. Specifically, we describe the construction of dialectograms, an unsupervised way to visually explore the characteristic ways in which each community use a focal word. Based on these dialectograms, we provide a new measure of the degree to which words are used differently that overcomes the tendency for existing measures to pick out low frequent or polysemous words. We apply our methods to explore the discourses of two US political subreddits and show how our methods identify stark affective polarisation of politicians and political entities, differences in the assessment of proper political action as well as disagreement about whether certain issues require political intervention at all.
Breaking Into AI: Sahar Nasiri on Acing the Data Science Job Interview
Data scientist Sahar Nasiri originally went to college to study industrial engineering. After taking Andrew Ng's Machine Learning course on a professor's recommendation, however, she knew she wanted her future to be in AI. Now she uses AI to help Delta Airlines keep its planes in top operating condition. She spoke with us about her early interview struggles, how she landed her first job, and the value of truly understanding statistics. Can you tell me about your current role? When did you start, what is your title, and what are your primary responsibilities?
Machine Learning: Concepts and Applications
This course gives you a comprehensive introduction to both the theory and practice of machine learning. You will learn to use Python along with industry-standard libraries and tools, including Pandas, Scikit-learn, and Tensorflow, to ingest, explore, and prepare data for modeling and then train and evaluate models using a wide variety of techniques. Those techniques include linear regression with ordinary least squares, logistic regression, support vector machines, decision trees and ensembles, clustering, principal component analysis, hidden Markov models, and deep learning. A key feature of this course is that you not only learn how to apply these techniques, you also learn the conceptual basis underlying them so that you understand how they work, why you are doing what you are doing, and what your results mean. The course also features real-world datasets, drawn primarily from the realm of public policy.
Stochastic Multiple Target Sampling Gradient Descent
Phan, Hoang, Tran, Ngoc, Le, Trung, Tran, Toan, Ho, Nhat, Phung, Dinh
Sampling from an unnormalized target distribution is an essential problem with many applications in probabilistic inference. Stein Variational Gradient Descent (SVGD) has been shown to be a powerful method that iteratively updates a set of particles to approximate the distribution of interest. Furthermore, when analysing its asymptotic properties, SVGD reduces exactly to a single-objective optimization problem and can be viewed as a probabilistic version of this single-objective optimization problem. A natural question then arises: "Can we derive a probabilistic version of the multi-objective optimization?". To answer this question, we propose Stochastic Multiple Target Sampling Gradient Descent (MT-SGD), enabling us to sample from multiple unnormalized target distributions. Specifically, our MT-SGD conducts a flow of intermediate distributions gradually orienting to multiple target distributions, which allows the sampled particles to move to the joint high-likelihood region of the target distributions. Interestingly, the asymptotic analysis shows that our approach reduces exactly to the multiple-gradient descent algorithm for multi-objective optimization, as expected. Finally, we conduct comprehensive experiments to demonstrate the merit of our approach to multi-task learning.
Robust multi-item auction design using statistical learning: Overcoming uncertainty in bidders' types distributions
This paper presents a novel mechanism design for multi-item auction settings with uncertain bidders' type distributions. Our proposed approach utilizes nonparametric density estimation to accurately estimate bidders' types from historical bids, and is built upon the Vickrey-Clarke-Groves (VCG) mechanism, ensuring satisfaction of Bayesian incentive compatibility (BIC) and $\delta$-individual rationality (IR). To further enhance the efficiency of our mechanism, we introduce two novel strategies for query reduction: a filtering method that screens potential winners' value regions within the confidence intervals generated by our estimated distribution, and a classification strategy that designates the lower bound of an interval as the estimated type when the length is below a threshold value. Simulation experiments conducted on both small-scale and large-scale data demonstrate that our mechanism consistently outperforms existing methods in terms of revenue maximization and query reduction, particularly in large-scale scenarios. This makes our proposed mechanism a highly desirable and effective option for sellers in the realm of multi-item auctions.