Law
FedCP: Separating Feature Information for Personalized Federated Learning via Conditional Policy
Zhang, Jianqing, Hua, Yang, Wang, Hao, Song, Tao, Xue, Zhengui, Ma, Ruhui, Guan, Haibing
Recently, personalized federated learning (pFL) has attracted increasing attention in privacy protection, collaborative learning, and tackling statistical heterogeneity among clients, e.g., hospitals, mobile smartphones, etc. Most existing pFL methods focus on exploiting the global information and personalized information in the client-level model parameters while neglecting that data is the source of these two kinds of information. To address this, we propose the Federated Conditional Policy (FedCP) method, which generates a conditional policy for each sample to separate the global information and personalized information in its features and then processes them by a global head and a personalized head, respectively. FedCP is more fine-grained to consider personalization in a sample-specific manner than existing pFL methods. Extensive experiments in computer vision and natural language processing domains show that FedCP outperforms eleven state-of-the-art methods by up to 6.69%. Furthermore, FedCP maintains its superiority when some clients accidentally drop out, which frequently happens in mobile settings. Our code is public at https://github.com/TsingZ0/FedCP.
Fair Streaming Principal Component Analysis: Statistical and Algorithmic Viewpoint
Lee, Junghyun, Cho, Hanseul, Yun, Se-Young, Yun, Chulhee
Fair Principal Component Analysis (PCA) is a problem setting where we aim to perform PCA while making the resulting representation fair in that the projected distributions, conditional on the sensitive attributes, match one another. However, existing approaches to fair PCA have two main problems: theoretically, there has been no statistical foundation of fair PCA in terms of learnability; practically, limited memory prevents us from using existing approaches, as they explicitly rely on full access to the entire data. On the theoretical side, we rigorously formulate fair PCA using a new notion called \emph{probably approximately fair and optimal} (PAFO) learnability. On the practical side, motivated by recent advances in streaming algorithms for addressing memory limitation, we propose a new setting called \emph{fair streaming PCA} along with a memory-efficient algorithm, fair noisy power method (FNPM). We then provide its {\it statistical} guarantee in terms of PAFO-learnability, which is the first of its kind in fair PCA literature. Lastly, we verify the efficacy and memory efficiency of our algorithm on real-world datasets.
Experts call Biden executive order on AI a 'first step,' but some express doubts
Fox News correspondent Gillian Turner has the latest on the president's focus amid calls for an impeachment inquiry on'Special Report.' President Biden is expected to unveil an executive order (EO) regulating artificial intelligence, a step long called for by some experts. "I applaud the administration for taking the first step," Phil Siegel, the founder of the Center for Advanced Preparedness and Threat Response Simulation (CAPTRS), told Fox News Digital. "We should applaud the first step through the EO but quickly need a framework for the detailed steps beyond that truly safeguard our freedoms." Siegel's comments come after The Washington Post reported Wednesday on Biden administration plans for an executive order on AI, which the paper called the "most significant attempt" the government has so far made to regular a technology that has been advancing at a seemingly rapid pace. The move follows through on Biden's pledge earlier this year, when he vowed executive action that would ensure "America leads the way toward responsible AI innovation."
A Global Multi-Unit Calibration as a Method for Large Scale IoT Particulate Matter Monitoring Systems Deployments
De Vito, Saverio, Elia, Gerardo D, Ferlito, Sergio, Di Francia, Girolamo, Davidovic, Milos, Kleut, Duska, Stojanovic, Danka, Stojanovic, Milena Jovasevic
Scalable and effective calibration is a fundamental requirement for Low Cost Air Quality Monitoring Systems and will enable accurate and pervasive monitoring in cities. Suffering from environmental interferences and fabrication variance, these devices need to encompass sensors specific and complex calibration processes for reaching a sufficient accuracy to be deployed as indicative measurement devices in Air Quality (AQ) monitoring networks. Concept and sensor drift often force calibration process to be frequently repeated. These issues lead to unbearable calibration costs which denies their massive deployment when accuracy is a concern. In this work, We propose a zero transfer samples, global calibration methodology as a technological enabler for IoT AQ multisensory devices which relies on low cost Particulate Matter (PM) sensors. This methodology is based on field recorded responses from a limited number of IoT AQ multisensors units and machine learning concepts and can be universally applied to all units of the same type. A multi season test campaign shown that, when applied to different sensors, this methodology performances match those of state of the art methodology which requires to derive different calibration parameters for each different unit. If confirmed, these results show that, when properly derived, a global calibration law can be exploited for a large number of networked devices with dramatic cost reduction eventually allowing massive deployment of accurate IoT AQ monitoring devices. Furthermore, this calibration model could be easily embedded on board of the device or implemented on the edge allowing immediate access to accurate readings for personal exposure monitor applications as well as reducing long range data transfer needs.
Breaking the Trilemma of Privacy, Utility, Efficiency via Controllable Machine Unlearning
Liu, Zheyuan, Dou, Guangyao, Tian, Yijun, Zhang, Chunhui, Chien, Eli, Zhu, Ziwei
Machine Unlearning (MU) algorithms have become increasingly critical due to the imperative adherence to data privacy regulations. The primary objective of MU is to erase the influence of specific data samples on a given model without the need to retrain it from scratch. Accordingly, existing methods focus on maximizing user privacy protection. However, there are different degrees of privacy regulations for each real-world web-based application. Exploring the full spectrum of trade-offs between privacy, model utility, and runtime efficiency is critical for practical unlearning scenarios. Furthermore, designing the MU algorithm with simple control of the aforementioned trade-off is desirable but challenging due to the inherent complex interaction. To address the challenges, we present Controllable Machine Unlearning (ConMU), a novel framework designed to facilitate the calibration of MU. The ConMU framework contains three integral modules: an important data selection module that reconciles the runtime efficiency and model generalization, a progressive Gaussian mechanism module that balances privacy and model generalization, and an unlearning proxy that controls the trade-offs between privacy and runtime efficiency. Comprehensive experiments on various benchmark datasets have demonstrated the robust adaptability of our control mechanism and its superiority over established unlearning methods. ConMU explores the full spectrum of the Privacy-Utility-Efficiency trade-off and allows practitioners to account for different real-world regulations. Source code available at: https://github.com/guangyaodou/ConMU.
How Well Do Feature-Additive Explainers Explain Feature-Additive Predictors?
Carmichael, Zachariah, Scheirer, Walter J.
Surging interest in deep learning from high-stakes domains has precipitated concern over the inscrutable nature of black box neural networks. Explainable AI (XAI) research has led to an abundance of explanation algorithms for these black boxes. Such post hoc explainers produce human-comprehensible explanations, however, their fidelity with respect to the model is not well understood - explanation evaluation remains one of the most challenging issues in XAI. In this paper, we ask a targeted but important question: can popular feature-additive explainers (e.g., LIME, SHAP, SHAPR, MAPLE, and PDP) explain feature-additive predictors? Herein, we evaluate such explainers on ground truth that is analytically derived from the additive structure of a model. We demonstrate the efficacy of our approach in understanding these explainers applied to symbolic expressions, neural networks, and generalized additive models on thousands of synthetic and several real-world tasks. Our results suggest that all explainers eventually fail to correctly attribute the importance of features, especially when a decision-making process involves feature interactions.
Modeling Legal Reasoning: LM Annotation at the Edge of Human Agreement
Thalken, Rosamond, Stiglitz, Edward H., Mimno, David, Wilkens, Matthew
Generative language models (LMs) are increasingly used for document class-prediction tasks and promise enormous improvements in cost and efficiency. Existing research often examines simple classification tasks, but the capability of LMs to classify on complex or specialized tasks is less well understood. We consider a highly complex task that is challenging even for humans: the classification of legal reasoning according to jurisprudential philosophy. Using a novel dataset of historical United States Supreme Court opinions annotated by a team of domain experts, we systematically test the performance of a variety of LMs. We find that generative models perform poorly when given instructions (i.e. prompts) equal to the instructions presented to human annotators through our codebook. Our strongest results derive from fine-tuning models on the annotated dataset; the best performing model is an in-domain model, LEGAL-BERT. We apply predictions from this fine-tuned model to study historical trends in jurisprudence, an exercise that both aligns with prominent qualitative historical accounts and points to areas of possible refinement in those accounts. Our findings generally sound a note of caution in the use of generative LMs on complex tasks without fine-tuning and point to the continued relevance of human annotation-intensive classification methods.
Socially Cognizant Robotics for a Technology Enhanced Society
Dana, Kristin J., Andrews, Clinton, Bekris, Kostas, Feldman, Jacob, Stone, Matthew, Hemmer, Pernille, Mazzeo, Aaron, Salzman, Hal, Yi, Jingang
Applications of robotics (such as telepresence, transportation, elder-care, remote health care, cleaning, warehouse logistics, and delivery) are bringing significant changes in individuals' lives and are having profound social impact. Despite the envisioned potential of robotics, the goal of ubiquitous robot assistants augmenting quality of life (and quality of work life) has not yet been realized. Key challenges lie in the complexities of four overarching human-centric objectives that such systems must aim for: 1) improving quality of life of people, especially marginalized communities; 2) anticipating and mitigating unintended negative consequences of technological development; 3) enabling robots to adapt to the desires and needs of human counterparts; 4) respecting the need for human autonomy and agency. Pursuing these objectives requires an integrated cohort of technologists, behavioral scientists and social scientists with a shared vision to pursue a deep, multidisciplinary understanding of how robots interact with individuals and society. We introduce a new term, socially cognizant robotics, to describe this multi-faceted interdisciplinary branch of technology. The emerging practitioner, the socially cognizant roboticist, represents the convergence of socially aware technologists, who can develop intelligent devices that adapt to human and social behavior; and technology-aware social scientists and policymakers, who can translate studies of robotics' social effects into actionable and technically-viable principles and policies. A primary element of socially cognizant robotics is a deliberate "invitation to the table" for social scientists, who bring analytical perspectives and methods that are not typically present in robotics. These perspectives cover two levels of human-technology interaction that we view as essential: the human-robot dyad (Section 2) and the robot-society dyad (Section 3). Figure 1 illustrates how these levels might operate in the context of the workplace and everyday life.
Moral Responsibility for AI Systems
As more and more decisions that have a significant ethical dimension are being outsourced to AI systems, it is important to have a definition of moral responsibility that can be applied to AI systems. Moral responsibility for an outcome of an agent who performs some action is commonly taken to involve both a causal condition and an epistemic condition: the action should cause the outcome, and the agent should have been aware -- in some form or other -- of the possible moral consequences of their action. This paper presents a formal definition of both conditions within the framework of causal models. I compare my approach to the existing approaches of Braham and van Hees (BvH) and of Halpern and Kleiman-Weiner (HK). I then generalize my definition into a degree of responsibility.
ProcNet: Deep Predictive Coding Model for Robust-to-occlusion Visual Segmentation and Pose Estimation
Zechmair, Michael, Bornet, Alban, Morel, Yannick
Systems involving human-robot collaboration necessarily require that steps be taken to ensure safety of the participating human. This is usually achievable if accurate, reliable estimates of the human's pose are available. In this paper, we present a deep Predictive Coding (PC) model supporting visual segmentation, which we extend to pursue pose estimation. The model is designed to offer robustness to the type of transient occlusion naturally occurring when human and robot are operating in close proximity to one another. Impact on performance of relevant model parameters is assessed, and comparison to an alternate pose estimation model (NVIDIA's PoseCNN) illustrates efficacy of the proposed approach.