Government
Apple, Google Join Companies Pledging to Change Practices on Race
Microsoft Corp. said it won't sell facial-recognition technology to U.S. police until there is a national law regulating its use, echoing similar commitments from Amazon.com Inc. and International Business Machines Corp. made this week. The trio of technology companies have called for clearer federal rules around the surveillance technology amid widespread concern about its potential for racial bias. Meanwhile, the popular fantasy card game, "Magic: The Gathering," removed several cards it deemed racist or culturally offensive from its database, including one depicting figures in pointed hoods. The Hasbro-subsidiary behind the game also pledged to review all cards for material deemed inappropriate. The moves are the latest public actions by businesses lining up to show their commitment to racial equality.
Fast Maximum Likelihood Estimation and Supervised Classification for the Beta-Liouville Multinomial
Lakin, Steven Michael, Abdo, Zaid
The multinomial and related distributions have long been used to model categorical, count-based data in fields ranging from bioinformatics to natural language processing. Commonly utilized variants include the standard multinomial and the Dirichlet multinomial distributions due to their computational efficiency and straightforward parameter estimation process. However, these distributions make strict assumptions about the mean, variance, and covariance between the categorical features being modeled. If these assumptions are not met by the data, it may result in poor parameter estimates and loss in accuracy for downstream applications like classification. Here, we explore efficient parameter estimation and supervised classification methods using an alternative distribution, called the Beta-Liouville multinomial, which relaxes some of the multinomial assumptions. We show that the Beta-Liouville multinomial is comparable in efficiency to the Dirichlet multinomial for Newton-Raphson maximum likelihood estimation, and that its performance on simulated data matches or exceeds that of the multinomial and Dirichlet multinomial distributions. Finally, we demonstrate that the Beta-Liouville multinomial outperforms the multinomial and Dirichlet multinomial on two out of four gold standard datasets, supporting its use in modeling data with low to medium class overlap in a supervised classification context.
FLeet: Online Federated Learning via Staleness Awareness and Performance Prediction
Damaskinos, Georgios, Guerraoui, Rachid, Kermarrec, Anne-Marie, Nitu, Vlad, Patra, Rhicheek, Taiani, Francois
Federated Learning (FL) is very appealing for its privacy benefits: essentially, a global model is trained with updates computed on mobile devices while keeping the data of users local. Standard FL infrastructures are however designed to have no energy or performance impact on mobile devices, and are therefore not suitable for applications that require frequent (online) model updates, such as news recommenders. This paper presents FLeet, the first Online FL system, acting as a middleware between the Android OS and the machine learning application. FLeet combines the privacy of Standard FL with the precision of online learning thanks to two core components: (i) I-Prof, a new lightweight profiler that predicts and controls the impact of learning tasks on mobile devices, and (ii) AdaSGD, a new adaptive learning algorithm that is resilient to delayed updates. Our extensive evaluation shows that Online FL, as implemented by FLeet, can deliver a 2.3x quality boost compared to Standard FL, while only consuming 0.036% of the battery per day. I-Prof can accurately control the impact of learning tasks by improving the prediction accuracy up to 3.6x (computation time) and up to 19x (energy). AdaSGD outperforms alternative FL approaches by 18.4% in terms of convergence speed on heterogeneous data.
Distributed Differentially Private Averaging with Improved Utility and Robustness to Malicious Parties
Sabater, Cรฉsar, Bellet, Aurรฉlien, Ramon, Jan
Learning from data owned by several parties, as in federated learning, raises challenges regarding the privacy guarantees provided to participants and the correctness of the computation in the presence of malicious parties. We tackle these challenges in the context of distributed averaging, an essential building block of distributed and federated learning. Our first contribution is a novel distributed differentially private protocol which naturally scales with the number of parties. The key idea underlying our protocol is to exchange correlated Gaussian noise along the edges of a network graph, complemented by independent noise added by each party. We analyze the differential privacy guarantees of our protocol and the impact of the graph topology, showing that we can match the accuracy of the trusted curator model even when each party communicates with only a logarithmic number of other parties chosen at random. This is in contrast with protocols in the local model of privacy (with lower accuracy) or based on secure aggregation (where all pairs of users need to exchange messages). Our second contribution is to enable users to prove the correctness of their computations without compromising the efficiency and privacy guarantees of the protocol. Our construction relies on standard cryptographic primitives like commitment schemes and zero knowledge proofs.
Confidence Interval for Off-Policy Evaluation from Dependent Samples via Bandit Algorithm: Approach from Standardized Martingales
This study addresses the problem of off-policy evaluation (OPE) from dependent samples obtained via the bandit algorithm. The goal of OPE is to evaluate a new policy using historical data obtained from behavior policies generated by the bandit algorithm. Because the bandit algorithm updates the policy based on past observations, the samples are not independent and identically distributed (i.i.d.). However, several existing methods for OPE do not take this issue into account and are based on the assumption that samples are i.i.d. In this study, we address this problem by constructing an estimator from a standardized martingale difference sequence. To standardize the sequence, we consider using evaluation data or sample splitting with a two-step estimation. This technique produces an estimator with asymptotic normality without restricting a class of behavior policies. In an experiment, the proposed estimator performs better than existing methods, which assume that the behavior policy converges to a time-invariant policy.
A Formal Language Approach to Explaining RNNs
Ghosh, Bishwamittra, Neider, Daniel
This paper presents LEXR, a framework for explaining the decision making of recurrent neural networks (RNNs) using a formal description language called Linear Temporal Logic (LTL). LTL is the de facto standard for the specification of temporal properties in the context of formal verification and features many desirable properties that make the generated explanations easy for humans to interpret: it is a descriptive language, it has a variable-free syntax, and it can easily be translated into plain English. To generate explanations, LEXR follows the principle of counterexample-guided inductive synthesis and combines Valiant's probably approximately correct learning (PAC) with constraint solving. We prove that LEXR's explanations satisfy the PAC guarantee (provided the RNN can be described by LTL) and show empirically that these explanations are more accurate and easier-to-understand than the ones generated by recent algorithms that extract deterministic finite automata from RNNs.
Experimental Evaluation and Development of a Silver-Standard for the MIMIC-III Clinical Coding Dataset
Searle, Thomas, Ibrahim, Zina, Dobson, Richard JB
Clinical coding is currently a labour-intensive, error-prone, but critical administrative process whereby hospital patient episodes are manually assigned codes by qualified staff from large, standardised taxonomic hierarchies of codes. Automating clinical coding has a long history in NLP research and has recently seen novel developments setting new state of the art results. A popular dataset used in this task is MIMIC-III, a large intensive care database that includes clinical free text notes and associated codes. We argue for the reconsideration of the validity MIMIC-III's assigned codes that are often treated as gold-standard, especially when MIMIC-III has not undergone secondary validation. This work presents an open-source, reproducible experimental methodology for assessing the validity of codes derived from EHR discharge summaries. We exemplify the methodology with MIMIC-III discharge summaries and show the most frequently assigned codes in MIMIC-III are under-coded up to 35%.
Amazon Bans Police Use of Its Face Recognition for a Year
"Amazon's decision is an important symbolic step, but this doesn't really change the face recognition landscape in the United States since it's not a major player," said Clare Garvie, a researcher at Georgetown University's Center on Privacy and Technology. Her public records research found only two U.S. agencies using or testing Rekognition. The Washington County Sheriff's Office in Oregon has been the most public about using it. The Orlando police department tested it, but chose not to implement it, she said.
The US protests and the echoes of imperial violence
The US is using methods of violence against domestic protests it has repeatedly used in its imperial adventures abroad. As the world was gripped by the shocking scenes of police brutality against the Black community in the United States and the aggressive posture adopted by President Donald Trump against the protestors, an important development was missed by many observers. On May 29, the US Customs and Border Protection (CBP) agency flew a Predator drone, the machine used to kill suspected terrorists around the world, over the protestors in Minneapolis. The use of the drone led to immediate condemnations from civil rights groups on the ground, as the city of Minneapolis lies outside the 100-air-mile border zone where the CBP has jurisdiction. The incident is significant because it reflects the willingness of the US authorities to use technology developed to propagate imperial designs abroad against their own citizens.
The Smoothed Possibility of Social Choice
We develop a framework to leverage the elegant "worst average-case" idea in smoothed complexity analysis to social choice, motivated by modern applications of social choice powered by AI and ML. Using our framework, we characterize the smoothed likelihood of some fundamental paradoxes and impossibility theorems as the number of agents increases. For Condrocet's paradox, we prove that the smoothed likelihood of the paradox either vanishes at an exponential rate, or does not vanish at all. For the folklore impossibility on the non-existence of voting rules that satisfy anonymity and neutrality, we characterize the rate for the impossibility to vanish, to be either polynomially fast or exponentially fast. We also propose a novel easy-to-compute tie-breaking mechanism that optimally preserves anonymity and neutrality for even number of alternatives in natural settings. Our results illustrate the smoothed possibility of social choice---even though the paradox and the impossibility theorem hold in the worst case, they may not be a big concern in practice in certain natural settings.