Oceania
Accountability in an Algorithmic Society: Relationality, Responsibility, and Robustness in Machine Learning
Cooper, A. Feder, Laufer, Benjamin, Moss, Emanuel, Nissenbaum, Helen
In 1996, philosopher Helen Nissenbaum issued a clarion call concerning the erosion of accountability in society due to the ubiquitous delegation of consequential functions to computerized systems. Using the conceptual framing of moral blame, Nissenbaum described four types of barriers to accountability that computerization presented: 1) "many hands," the problem of attributing moral responsibility for outcomes caused by many moral actors; 2) "bugs," a way software developers might shrug off responsibility by suggesting software errors are unavoidable; 3) "computer as scapegoat," shifting blame to computer systems as if they were moral actors; and 4) "ownership without liability," a free pass to the tech industry to deny responsibility for the software they produce. We revisit these four barriers in relation to the recent ascendance of data-driven algorithmic systems--technology often folded under the heading of machine learning (ML) or artificial intelligence (AI)--to uncover the new challenges for accountability that these systems present. We then look ahead to how one might construct and justify a moral, relational framework for holding responsible parties accountable, and argue that the FAccT community is uniquely well-positioned to develop such a framework to weaken the four barriers.
TaxoEnrich: Self-Supervised Taxonomy Completion via Structure-Semantic Representations
Jiang, Minhao, Song, Xiangchen, Zhang, Jieyu, Han, Jiawei
Taxonomies are fundamental to many real-world applications in various domains, serving as structural representations of knowledge. To deal with the increasing volume of new concepts needed to be organized as taxonomies, researchers turn to automatically completion of an existing taxonomy with new concepts. In this paper, we propose TaxoEnrich, a new taxonomy completion framework, which effectively leverages both semantic features and structural information in the existing taxonomy and offers a better representation of candidate position to boost the performance of taxonomy completion. Specifically, TaxoEnrich consists of four components: (1) taxonomy-contextualized embedding which incorporates both semantic meanings of concept and taxonomic relations based on powerful pretrained language models; (2) a taxonomy-aware sequential encoder which learns candidate position representations by encoding the structural information of taxonomy; (3) a query-aware sibling encoder which adaptively aggregates candidate siblings to augment candidate position representations based on their importance to the query-position matching; (4) a query-position matching model which extends existing work with our new candidate position representations. Extensive experiments on four large real-world datasets from different domains show that \TaxoEnrich achieves the best performance among all evaluation metrics and outperforms previous state-of-the-art methods by a large margin.
Typical Decoding for Natural Language Generation
Meister, Clara, Pimentel, Tiago, Wiher, Gian, Cotterell, Ryan
Despite achieving incredibly low perplexities on myriad natural language corpora, today's language models still often underperform when used to generate text. This dichotomy has puzzled the language generation community for the last few years. In this work, we posit that the abstraction of natural language as a communication channel (\`a la Shannon, 1948) can provide new insights into the behaviors of probabilistic language generators, e.g., why high-probability texts can be dull or repetitive. Humans use language as a means of communicating information, and do so in an efficient yet error-minimizing manner, choosing each word in a string with this (perhaps subconscious) goal in mind. We propose that generation from probabilistic models should mimic this behavior. Rather than always choosing words from the high-probability region of the distribution--which have a low Shannon information content--we sample from the set of words with an information content close to its expected value, i.e., close to the conditional entropy of our model. This decision criterion can be realized through a simple and efficient implementation, which we call typical sampling. Automatic and human evaluations show that, in comparison to nucleus and top-k sampling, typical sampling offers competitive performance in terms of quality while consistently reducing the number of degenerate repetitions.
Democrats urge federal agencies to ditch Clearview AI's facial recognition tech
Four Democratic senators and House representatives have called on several government departments to stop using Clearview AI's facial recognition system. The Government Accountability Office said in August that the Departments of Justice, Defense, Homeland Security and the Interior were all using the contentious technology for "domestic law enforcement." Pramila Jayapal and Ayanna Pressley urged the agencies to refrain from using Clearview's products and other facial recognition tools. "Clearview AI's technology could eliminate public anonymity in the United States," the lawmakers wrote to the agencies in their letters, which were obtained by The Verge. They said that, combined with the facial recognition system, the database of billions of photos Clearview scraped from social media platforms "is capable of fundamentally dismantling Americans' expectation that they can move, assemble or simply appear in public without being identified."
The Morning After: What's going to happen to Peloton?
One of the stars of the working-out-from-home boom is struggling. Peloton won't go quietly though and is making some big changes. The company will replace the CEO and co-founder, John Foley, who will become executive chairman, with former Spotify COO Barry McCarthy reportedly set to step into his shoes. While Foley is sticking around, the company is cutting around 2,800 corporate positions -- these won't include Peloton's instructors who lead its live classes. The company said in a press release about the lay-offs that its "monthly membership will be complimentary for impacted team members for an additional 12 months."
Biden moves to soothe allies in China's shadow with Japan deal
The partial lifting of U.S. metals tariffs slapped on Japan under former U.S. President Donald Trump's administration is the latest bid by U.S. President Joe Biden's government to mend ties with a major ally and counterbalance an increasingly powerful China. Biden inherited a global network of alliances that had been battered by Trump's repeated questioning of their value to the United States, even as many saw such ties as increasingly important, given China's growing wealth and military might. "First, you treat allies as allies," U.S. Ambassador to Japan Rahm Emanuel said in a phone interview Tuesday. "Second, you begin to make a down payment on both climate and standing up for a rules-based system by recognizing nonmarket forces like China have wreaked havoc." The deal on steel tariffs comes as the U.S. seeks to redefine its role in how trade policy is made in Asia following Trump's rejection of the Trans-Pacific Partnership regional trade pact his country once spearheaded.
Bias-Eliminated Semantic Refinement for Any-Shot Learning
Feng, Liangjun, Zhao, Chunhui, Li, Xi
When training samples are scarce, the semantic embedding technique, ie, describing class labels with attributes, provides a condition to generate visual features for unseen objects by transferring the knowledge from seen objects. However, semantic descriptions are usually obtained in an external paradigm, such as manual annotation, resulting in weak consistency between descriptions and visual features. In this paper, we refine the coarse-grained semantic description for any-shot learning tasks, ie, zero-shot learning (ZSL), generalized zero-shot learning (GZSL), and few-shot learning (FSL). A new model, namely, the semantic refinement Wasserstein generative adversarial network (SRWGAN) model, is designed with the proposed multihead representation and hierarchical alignment techniques. Unlike conventional methods, semantic refinement is performed with the aim of identifying a bias-eliminated condition for disjoint-class feature generation and is applicable in both inductive and transductive settings. We extensively evaluate model performance on six benchmark datasets and observe state-of-the-art results for any-shot learning; eg, we obtain 70.2% harmonic accuracy for the Caltech UCSD Birds (CUB) dataset and 82.2% harmonic accuracy for the Oxford Flowers (FLO) dataset in the standard GZSL setting. Various visualizations are also provided to show the bias-eliminated generation of SRWGAN. Our code is available.
Survey on Graph Neural Network Acceleration: An Algorithmic Perspective
Liu, Xin, Yan, Mingyu, Deng, Lei, Li, Guoqi, Ye, Xiaochun, Fan, Dongrui, Pan, Shirui, Xie, Yuan
First, explosive increase of graph data poses a great challenge to GNN training on large-scale datasets. Previously, Graph neural networks (GNNs) have been a hot many graph-based tasks were often conducted on toy datasets spot of recent research and are widely utilized in diverse that are relatively small compared to graphs in realistic applications, applications. However, with the use of huger which is harmful to model scalability and practical data and deeper models, an urgent demand is unsurprisingly usages. Currently, large-scale graph datasets are thereby proposed made to accelerate GNNs for more efficient in literature [Hu et al., 2020a] for advanced research, execution. In this paper, we provide a comprehensive and at the same time, making GNNs execution (i.e., training survey on acceleration methods for GNNs and inference) a time-consuming process.
FedQAS: Privacy-aware machine reading comprehension with federated learning
Ait-Mlouk, Addi, Alawadi, Sadi, Toor, Salman, Hellander, Andreas
Machine reading comprehension (MRC) of text data is one important task in Natural Language Understanding. It is a complex NLP problem with a lot of ongoing research fueled by the release of the Stanford Question Answering Dataset (SQuAD) and Conversational Question Answering (CoQA). It is considered to be an effort to teach computers how to "understand" a text, and then to be able to answer questions about it using deep learning. However, until now large-scale training on private text data and knowledge sharing has been missing for this NLP task. Hence, we present FedQAS, a privacy-preserving machine reading system capable of leveraging large-scale private data without the need to pool those datasets in a central location. The proposed approach combines transformer models and federated learning technologies. The system is developed using the FEDn framework and deployed as a proof-of-concept alliance initiative. FedQAS is flexible, language-agnostic, and allows intuitive participation and execution of local model training. In addition, we present the architecture and implementation of the system, as well as provide a reference evaluation based on the SQUAD dataset, to showcase how it overcomes data privacy issues and enables knowledge sharing between alliance members in a Federated learning setting.
FCM-DNN: diagnosing coronary artery disease by deep accuracy Fuzzy C-Means clustering model
Joloudari, Javad Hassannataj, Saadatfar, Hamid, GhasemiGol, Mohammad, Alizadehsani, Roohallah, Sani, Zahra Alizadeh, Hasanzadeh, Fereshteh, Hassannataj, Edris, Sharifrazi, Danial, Mansor, Zulkefli
Cardiovascular disease is one of the most challenging diseases in middle-aged and older people, which causes high mortality. Coronary artery disease (CAD) is known as a common cardiovascular disease. A standard clinical tool for diagnosing CAD is angiography. The main challenges are dangerous side effects and high angiography costs. Today, the development of artificial intelligence-based methods is a valuable achievement for diagnosing disease. Hence, in this paper, artificial intelligence methods such as neural network (NN), deep neural network (DNN), and Fuzzy C-Means clustering combined with deep neural network (FCM-DNN) are developed for diagnosing CAD on a cardiac magnetic resonance imaging (CMRI) dataset. The original dataset is used in two different approaches. First, the labeled dataset is applied to the NN and DNN to create the NN and DNN models. Second, the labels are removed, and the unlabeled dataset is clustered via the FCM method, and then, the clustered dataset is fed to the DNN to create the FCM-DNN model. By utilizing the second clustering and modeling, the training process is improved, and consequently, the accuracy is increased. As a result, the proposed FCM-DNN model achieves the best performance with a 99.91% accuracy specifying 10 clusters, i.e., 5 clusters for healthy subjects and 5 clusters for sick subjects, through the 10-fold cross-validation technique compared to the NN and DNN models reaching the accuracies of 92.18% and 99.63%, respectively. To the best of our knowledge, no study has been conducted for CAD diagnosis on the CMRI dataset using artificial intelligence methods. The results confirm that the proposed FCM-DNN model can be helpful for scientific and research centers.