Goto

Collaborating Authors

 Law


Interactive Concept Learning for Uncovering Latent Themes in Large Text Collections

arXiv.org Artificial Intelligence

Experts across diverse disciplines are often interested in making sense of large text collections. Traditionally, this challenge is approached either by noisy unsupervised techniques such as topic models, or by following a manual theme discovery process. In this paper, we expand the definition of a theme to account for more than just a word distribution, and include generalized concepts deemed relevant by domain experts. Then, we propose an interactive framework that receives and encodes expert feedback at different levels of abstraction. Our framework strikes a balance between automation and manual coding, allowing experts to maintain control of their study while reducing the manual effort required.


Even if Explanations: Prior Work, Desiderata & Benchmarks for Semi-Factual XAI

arXiv.org Artificial Intelligence

Recently, eXplainable AI (XAI) research has focused on counterfactual explanations as post-hoc justifications for AI-system decisions (e.g. a customer refused a loan might be told: If you asked for a loan with a shorter term, it would have been approved). Counterfactuals explain what changes to the input-features of an AI system change the output-decision. However, there is a sub-type of counterfactual, semi-factuals, that have received less attention in AI (though the Cognitive Sciences have studied them extensively). This paper surveys these literatures to summarise historical and recent breakthroughs in this area. It defines key desiderata for semi-factual XAI and reports benchmark tests of historical algorithms (along with a novel, naieve method) to provide a solid basis for future algorithmic developments.


What Is Fairness? Philosophical Considerations and Implications For FairML

arXiv.org Artificial Intelligence

However, a fundamental question remains: What is fairness? This question is not so easy to answer and is often skipped; instead of asking "what is fairness", the questions of "how to measure fairness of ML models" and "how to make ML models fair" are pursued. This paper does not intend to criticize individual approaches that address those latter questions and often propose important solutions. Rather, the aim is to make explicit the premises that underlie the various understandings of fairness and the approaches to solving fairness problems. In doing so, a largely concordant understanding can be elaborated that is based on a rich foundation in the history of philosophy. Subsequently, we show that the conception of fairness depends on multilayered normative evaluations; any discussion of fairML is reliant on adopting those normative stipulations. The basis for fair decisions is always the question of the equality of the people treated with respect to the subject matter concerned. With this decision basis, a decision rule is to be established, which in turn can be adapted to the concrete needs as a result of normative stipulations. Based on this basic concept of fairness, we turn to the questions of to what extent ML models can induce unfair treatments in automated decision-making (ADM), and of how to implement these normative stipulations in training an ML model and in using its predictions in ADM.


SemEval-2023 Task 10: Explainable Detection of Online Sexism

arXiv.org Artificial Intelligence

Online sexism is a widespread and harmful phenomenon. Automated tools can assist the detection of sexism at scale. Binary detection, however, disregards the diversity of sexist content, and fails to provide clear explanations for why something is sexist. To address this issue, we introduce SemEval Task 10 on the Explainable Detection of Online Sexism (EDOS). We make three main contributions: i) a novel hierarchical taxonomy of sexist content, which includes granular vectors of sexism to aid explainability; ii) a new dataset of 20,000 social media comments with fine-grained labels, along with larger unlabelled datasets for model adaptation; and iii) baseline models as well as an analysis of the methods, results and errors for participant submissions to our task.


Causal Reasoning and Large Language Models: Opening a New Frontier for Causality

arXiv.org Artificial Intelligence

The causal capabilities of large language models (LLMs) is a matter of significant debate, with critical implications for the use of LLMs in societally impactful domains such as medicine, science, law, and policy. We further our understanding of LLMs and their causal implications, considering the distinctions between different types of causal reasoning tasks, as well as the entangled threats of construct and measurement validity. LLM-based methods establish new state-of-the-art accuracies on multiple causal benchmarks. Algorithms based on GPT-3.5 and 4 outperform existing algorithms on a pairwise causal discovery task (97%, 13 points gain), counterfactual reasoning task (92%, 20 points gain), and actual causality (86% accuracy in determining necessary and sufficient causes in vignettes). At the same time, LLMs exhibit unpredictable failure modes and we provide some techniques to interpret their robustness. Crucially, LLMs perform these causal tasks while relying on sources of knowledge and methods distinct from and complementary to non-LLM based approaches. Specifically, LLMs bring capabilities so far understood to be restricted to humans, such as using collected knowledge to generate causal graphs or identifying background causal context from natural language. We envision LLMs to be used alongside existing causal methods, as a proxy for human domain knowledge and to reduce human effort in setting up a causal analysis, one of the biggest impediments to the widespread adoption of causal methods. We also see existing causal methods as promising tools for LLMs to formalize, validate, and communicate their reasoning especially in high-stakes scenarios. In capturing common sense and domain knowledge about causal mechanisms and supporting translation between natural language and formal methods, LLMs open new frontiers for advancing the research, practice, and adoption of causality.


U.S. Sanctions Drive Chinese Firms to Advance AI Without Latest Chips

WSJ.com: WSJD - Technology

U.S. sanctions are spurring Chinese tech companies to accelerate research to develop cutting-edge artificial intelligence without relying on the latest American chips. A Wall Street Journal review of research papers and interviews with employees found that Chinese companies are studying techniques that could allow them to achieve state-of-the-art AI performance with fewer or less powerful semiconductors. They are also researching how to combine different types of chips to avoid relying on any one type of hardware.


'Chilling effect': Israel's ongoing surveillance of Palestinians

Al Jazeera

For activist Issa Amro, the latest revelations from human rights group Amnesty International about Israel's ever-growing use of facial recognition technology against Palestinians come as no surprise. My people are suffering from it," he told Al Jazeera from Hebron. On May 2, Amnesty published a report titled Automated Apartheid, detailing the workings of Israel's Red Wolf programme – a facial recognition technology used to track Palestinians since last year that is believed to be linked to similar, earlier programmes known as Blue Wolf and Wolf Pack. The technology has been deployed at checkpoints in the city of Hebron and other parts of the occupied West Bank – scanning the faces of Palestinians and comparing them against existing databases. Palestinians, like anyone else, have the right to live in a world that upholds equality and dignity. Help dismantle Israel's apartheid and call for an end to the supply of facial recognition technologies used in the Occupied Palestinian ...


A-ePA*SE: Anytime Edge-Based Parallel A* for Slow Evaluations

arXiv.org Artificial Intelligence

Anytime search algorithms are useful for planning problems where a solution is desired under a limited time budget. Anytime algorithms first aim to provide a feasible solution quickly and then attempt to improve it until the time budget expires. On the other hand, parallel search algorithms utilize the multithreading capability of modern processors to speed up the search. One such algorithm, ePA*SE (Edge-Based Parallel A* for Slow Evaluations), parallelizes edge evaluations to achieve faster planning and is especially useful in domains with expensive-to-compute edges. In this work, we propose an extension that brings the anytime property to ePA*SE, resulting in A-ePA*SE. We evaluate A-ePA*SE experimentally and show that it is significantly more efficient than other anytime search methods. The open-source code for A-ePA*SE, along with the baselines, is available here: https://github.com/shohinm/parallel_search


Unlocking Practical Applications in Legal Domain: Evaluation of GPT for Zero-Shot Semantic Annotation of Legal Texts

arXiv.org Artificial Intelligence

We evaluated the capability of a state-of-the-art generative pre-trained transformer (GPT) model to perform semantic annotation of short text snippets (one to few sentences) coming from legal documents of various types. Discussions of potential uses (e.g., document drafting, summarization) of this emerging technology in legal domain have intensified, but to date there has not been a rigorous analysis of these large language models' (LLM) capacity in sentence-level semantic annotation of legal texts in zero-shot learning settings. Yet, this particular type of use could unlock many practical applications (e.g., in contract review) and research opportunities (e.g., in empirical legal studies). We fill the gap with this study. We examined if and how successfully the model can semantically annotate small batches of short text snippets (10-50) based exclusively on concise definitions of the semantic types. We found that the GPT model performs surprisingly well in zero-shot settings on diverse types of documents (F1=.73 on a task involving court opinions, .86 for contracts, and .54 for statutes and regulations). These findings can be leveraged by legal scholars and practicing lawyers alike to guide their decisions in integrating LLMs in wide range of workflows involving semantic annotation of legal texts.


Facilitating Fine-grained Detection of Chinese Toxic Language: Hierarchical Taxonomy, Resources, and Benchmarks

arXiv.org Artificial Intelligence

The widespread dissemination of toxic online posts is increasingly damaging to society. However, research on detecting toxic language in Chinese has lagged significantly. Existing datasets lack fine-grained annotation of toxic types and expressions, and ignore the samples with indirect toxicity. In addition, it is crucial to introduce lexical knowledge to detect the toxicity of posts, which has been a challenge for researchers. In this paper, we facilitate the fine-grained detection of Chinese toxic language. First, we built Monitor Toxic Frame, a hierarchical taxonomy to analyze toxic types and expressions. Then, a fine-grained dataset ToxiCN is presented, including both direct and indirect toxic samples. We also build an insult lexicon containing implicit profanity and propose Toxic Knowledge Enhancement (TKE) as a benchmark, incorporating the lexical feature to detect toxic language. In the experimental stage, we demonstrate the effectiveness of TKE. After that, a systematic quantitative and qualitative analysis of the findings is given.