Law
Adapting Fairness Interventions to Missing Values
Feng, Raymond, Calmon, Flavio P., Wang, Hao
Missing values in real-world data pose a significant and unique challenge to algorithmic fairness. Different demographic groups may be unequally affected by missing data, and the standard procedure for handling missing values where first data is imputed, then the imputed data is used for classification -- a procedure referred to as "impute-then-classify" -- can exacerbate discrimination. In this paper, we analyze how missing values affect algorithmic fairness. We first prove that training a classifier from imputed data can significantly worsen the achievable values of group fairness and average accuracy. This is because imputing data results in the loss of the missing pattern of the data, which often conveys information about the predictive label. We present scalable and adaptive algorithms for fair classification with missing values. These algorithms can be combined with any preexisting fairness-intervention algorithm to handle all possible missing patterns while preserving information encoded within the missing patterns. Numerical experiments with state-of-the-art fairness interventions demonstrate that our adaptive algorithms consistently achieve higher fairness and accuracy than impute-then-classify across different datasets.
A New Tool Helps Disabled People Track--and Shape--Laws That Impact Them
In 2010, Barack Obama signed the Plain Writing Act into law, requiring that federal government documents use clear, straightforward language. Plain-language documents serve a dual purpose: they can make information more accessible to people with disabilities that affect cognition and memory, but also address the fact that legislation is already complicated for most people to read--a case in point of how accessibility practices benefit even those without a particular disability. New Disabled South, a disability justice nonprofit founded in 2022, is trying to make more information available to disabled people on legislation that affects them, launching its Plain Language Policy Dashboard in November to cover 14 Southern states. As of now, the bills it explains fall into six categories: accessibility, civil rights, criminalization, poverty and care, democracy, and education. Dom Kelly, New Disabled South's CEO, told me that he hopes the dashboard--which uses AI to translate texts into plain language, which is then checked for accuracy--can also help "combat myths and disinformation" that spread on social media, like whether a mental healthโrelated bill could actually lead to more institutionalization.
Big Tech wants AI regulation. The rest of Silicon Valley is skeptical.
"We are still in the very early days of generative AI, and it's imperative that governments don't preemptively anoint winners and shut down competition through the adoption of onerous regulations only the largest firms can satisfy," said Garry Tan, the head of Y Combinator, a San Francisco-based start-up incubator that helped nurture companies including Airbnb and DoorDash when they were just starting. The current discussion hasn't incorporated the voices of smaller companies enough, Tan said, which he believes is key to fostering competition and engineering the safest ways to harness AI.
Vicarious Offense and Noise Audit of Offensive Speech Classifiers: Unifying Human and Machine Disagreement on What is Offensive
Weerasooriya, Tharindu Cyril, Dutta, Sujan, Ranasinghe, Tharindu, Zampieri, Marcos, Homan, Christopher M., KhudaBukhsh, Ashiqur R.
Offensive speech detection is a key component of content moderation. However, what is offensive can be highly subjective. This paper investigates how machine and human moderators disagree on what is offensive when it comes to real-world social web political discourse. We show that (1) there is extensive disagreement among the moderators (humans and machines); and (2) human and large-language-model classifiers are unable to predict how other human raters will respond, based on their political leanings. For (1), we conduct a noise audit at an unprecedented scale that combines both machine and human responses. For (2), we introduce a first-of-its-kind dataset of vicarious offense. Our noise audit reveals that moderation outcomes vary wildly across different machine moderators. Our experiments with human moderators suggest that political leanings combined with sensitive issues affect both first-person and vicarious offense. The dataset is available through https://github.com/Homan-Lab/voiced.
Kantian Deontology Meets AI Alignment: Towards Morally Robust Fairness Metrics
Deontological ethics, specifically understood through Immanuel Kant, provides a moral framework that emphasizes the importance of duties and principles, rather than the consequences of action. Understanding that despite the prominence of deontology, it is currently an overlooked approach in fairness metrics, this paper explores the compatibility of a Kantian deontological framework in fairness metrics, part of the AI alignment field. We revisit Kant's critique of utilitarianism, which is the primary approach in AI fairness metrics and argue that fairness principles should align with the Kantian deontological framework. By integrating Kantian ethics into AI alignment, we not only bring in a widely-accepted prominent moral theory but also strive for a more morally grounded AI landscape that better balances outcomes and procedures in pursuit of fairness and justice.
AI Agent as Urban Planner: Steering Stakeholder Dynamics in Urban Planning via Consensus-based Multi-Agent Reinforcement Learning
Qian, Kejiang, Mao, Lingjun, Liang, Xin, Ding, Yimin, Gao, Jin, Wei, Xinran, Guo, Ziyi, Li, Jiajie
In urban planning, land use readjustment plays a pivotal role in aligning land use configurations with the current demands for sustainable urban development. However, present-day urban planning practices face two main issues. Firstly, land use decisions are predominantly dependent on human experts. Besides, while resident engagement in urban planning can promote urban sustainability and livability, it is challenging to reconcile the diverse interests of stakeholders. To address these challenges, we introduce a Consensus-based Multi-Agent Reinforcement Learning framework for real-world land use readjustment. This framework serves participatory urban planning, allowing diverse intelligent agents as stakeholder representatives to vote for preferred land use types. Within this framework, we propose a novel consensus mechanism in reward design to optimize land utilization through collective decision making. To abstract the structure of the complex urban system, the geographic information of cities is transformed into a spatial graph structure and then processed by graph neural networks. Comprehensive experiments on both traditional top-down planning and participatory planning methods from real-world communities indicate that our computational framework enhances global benefits and accommodates diverse interests, leading to improved satisfaction across different demographic groups. By integrating Multi-Agent Reinforcement Learning, our framework ensures that participatory urban planning decisions are more dynamic and adaptive to evolving community needs and provides a robust platform for automating complex real-world urban planning processes.
Surveying (Dis)Parities and Concerns of Compute Hungry NLP Research
Lee, Ji-Ung, Puerto, Haritz, van Aken, Betty, Arase, Yuki, Forde, Jessica Zosa, Derczynski, Leon, Rรผcklรฉ, Andreas, Gurevych, Iryna, Schwartz, Roy, Strubell, Emma, Dodge, Jesse
Many recent improvements in NLP stem from the development and use of large pre-trained language models (PLMs) with billions of parameters. Large model sizes makes computational cost one of the main limiting factors for training and evaluating such models; and has raised severe concerns about the sustainability, reproducibility, and inclusiveness for researching PLMs. These concerns are often based on personal experiences and observations. However, there had not been any large-scale surveys that investigate them. In this work, we provide a first attempt to quantify these concerns regarding three topics, namely, environmental impact, equity, and impact on peer reviewing. By conducting a survey with 312 participants from the NLP community, we capture existing (dis)parities between different and within groups with respect to seniority, academia, and industry; and their impact on the peer reviewing process. For each topic, we provide an analysis and devise recommendations to mitigate found disparities, some of which already successfully implemented. Finally, we discuss additional concerns raised by many participants in free-text responses.
Fair Supervised Learning with A Simple Random Sampler of Sensitive Attributes
Sohn, Jinwon, Song, Qifan, Lin, Guang
As the data-driven decision process becomes dominating for industrial applications, fairness-aware machine learning arouses great attention in various areas. This work proposes fairness penalties learned by neural networks with a simple random sampler of sensitive attributes for non-discriminatory supervised learning. In contrast to many existing works that critically rely on the discreteness of sensitive attributes and response variables, the proposed penalty is able to handle versatile formats of the sensitive attributes, so it is more extensively applicable in practice than many existing algorithms. This penalty enables us to build a computationally efficient group-level in-processing fairness-aware training framework. Empirical evidence shows that our framework enjoys better utility and fairness measures on popular benchmark data sets than competing methods. We also theoretically characterize estimation errors and loss of utility of the proposed neural-penalized risk minimization problem.
Understanding Reconstruction Attacks with the Neural Tangent Kernel and Dataset Distillation
Loo, Noel, Hasani, Ramin, Lechner, Mathias, Amini, Alexander, Rus, Daniela
Modern deep learning requires large volumes of data, which could contain sensitive or private information that cannot be leaked. Recent work has shown for homogeneous neural networks a large portion of this training data could be reconstructed with only access to the trained network parameters. While the attack was shown to work empirically, there exists little formal understanding of its effective regime which datapoints are susceptible to reconstruction. In this work, we first build a stronger version of the dataset reconstruction attack and show how it can provably recover the \emph{entire training set} in the infinite width regime. We then empirically study the characteristics of this attack on two-layer networks and reveal that its success heavily depends on deviations from the frozen infinite-width Neural Tangent Kernel limit. Next, we study the nature of easily-reconstructed images. We show that both theoretically and empirically, reconstructed images tend to "outliers" in the dataset, and that these reconstruction attacks can be used for \textit{dataset distillation}, that is, we can retrain on reconstructed images and obtain high predictive accuracy.
How the leopard got its spots: Age-old question of how animals develop their patterns may have finally been solved - with the aid of British computer pioneer Alan Turing
From spotty leopards to stripy zebras, nature has no shortage of distinct patterns on animals and plants. Now, the age-old question of how these patterns developed may have finally been solved. Scientists have shown that the same physical process that helps remove dirt from laundry could play a role in how tropical fish get their colourful spots and stripes. For their study, the team at the University of Colorado Boulder drew on the groundbreaking work of British computer pioneer Alan Turing, dating back more than 70 years. They believe their findings could help develop new materials and even new drugs.