Law
AI firms may pay a high price for their software's artistic abilities John Naughton
Welcome to a good way to waste most of a working day. Many people think it's magical, which in a sense it is, at least as the magician Robert Neale portrayed it: a unique art form in which the magician creates elaborate mysteries during a performance, leaving the spectator baffled about how it was done. But if the spectator somehow manages to discover how the trick was done, then the magic disappears. So let us examine how Midjourney and its peers do their tricks.
Major UK retailers urged to quit 'authoritarian' police facial recognition strategy
Some of Britain's biggest retailers, including Tesco, John Lewis and Sainsbury's, have been urged to pull out of a new policing strategy amid warnings it risks wrongly criminalising people of colour, women and LGBTQ people. A coalition of 14 human rights groups has written to the main retailers โ also including Marks & Spencer, the Co-op, Next, Boots and Primark โ saying that their participation in a new government-backed scheme that relies heavily on facial recognition technology to combat shoplifting will "amplify existing inequalities in the criminal justice system". The letter, from Liberty, Amnesty International and Big Brother Watch, among others, questions the unchecked rollout of a technology that has provoked fierce criticism over its impact on privacy and human rights at a time when the European Union is seeking to ban the technology in public spaces through proposed legislation. "Facial recognition technology notoriously misidentifies people of colour, women and LGBTQ people, meaning that already marginalised groups are more likely to be subject to an invasive stop by police, or at increased risk of physical surveillance, monitoring and harassment by workers in your stores," the letter states.Its authors also express dismay that the move will "reverse steps" that big retailers introduced during the Black Lives Matter movement, including high-profile commitments to be champions of diversity, equality and inclusion. Meanwhile, concerns over the broadening use of facial recognition technology have further intensified after the emergence of details of a police watchlist used to justify the contentious decision to use biometric surveillance at July's Formula One British Grand Prix at Silverstone.
How to Create Images With ChatGPT's New Dall-E 3 Integration
OpenAI just integrated its newest image generator, Dall-E 3, into ChatGPT. The tool is currently in beta for subscribers to ChatGPT Plus, OpenAI's $20-a-month service. With Dall-E 3 turned on, you can prompt the chatbot in casual language to create a set of four distinct images. As more powerful image generators become available to the public, legal and ethical issues are gaining prominence. In addition to legal concerns, security experts have expressed fears about the potential for AI image generators to enable the further spread of disinformation.
LagrangeBench: A Lagrangian Fluid Mechanics Benchmarking Suite
Toshev, Artur P., Galletti, Gianluca, Fritz, Fabian, Adami, Stefan, Adams, Nikolaus A.
Machine learning has been successfully applied to grid-based PDE modeling in various scientific applications. However, learned PDE solvers based on Lagrangian particle discretizations, which are the preferred approach to problems with free surfaces or complex physics, remain largely unexplored. We present LagrangeBench, the first benchmarking suite for Lagrangian particle problems, focusing on temporal coarse-graining. In particular, our contribution is: (a) seven new fluid mechanics datasets (four in 2D and three in 3D) generated with the Smoothed Particle Hydrodynamics (SPH) method including the Taylor-Green vortex, lid-driven cavity, reverse Poiseuille flow, and dam break, each of which includes different physics like solid wall interactions or free surface, (b) efficient JAX-based API with various recent training strategies and three neighbor search routines, and (c) JAX implementation of established Graph Neural Networks (GNNs) like GNS and SEGNN with baseline results. Finally, to measure the performance of learned surrogates we go beyond established position errors and introduce physical metrics like kinetic energy MSE and Sinkhorn distance for the particle distribution. Our codebase is available at https://github.com/tumaer/lagrangebench .
Crossing the Aisle: Unveiling Partisan and Counter-Partisan Events in News Reporting
Zou, Kaijian, Zhang, Xinliang Frederick, Wu, Winston, Beauchamp, Nick, Wang, Lu
News media is expected to uphold unbiased reporting. Yet they may still affect public opinion by selectively including or omitting events that support or contradict their ideological positions. Prior work in NLP has only studied media bias via linguistic style and word usage. In this paper, we study to which degree media balances news reporting and affects consumers through event inclusion or omission. We first introduce the task of detecting both partisan and counter-partisan events: events that support or oppose the author's political ideology. To conduct our study, we annotate a high-quality dataset, PAC, containing 8,511 (counter-)partisan event annotations in 304 news articles from ideologically diverse media outlets. We benchmark PAC to highlight the challenges of this task. Our findings highlight both the ways in which the news subtly shapes opinion and the need for large language models that better understand events within a broader context. Our dataset can be found at https://github.com/launchnlp/Partisan-Event-Dataset.
Using Large Language Models to Support Thematic Analysis in Empirical Legal Studies
Drรกpal, Jakub, Westermann, Hannes, Savelka, Jaromir
Thematic analysis and other variants of inductive coding are widely used qualitative analytic methods within empirical legal studies (ELS). We propose a novel framework facilitating effective collaboration of a legal expert with a large language model (LLM) for generating initial codes (phase 2 of thematic analysis), searching for themes (phase 3), and classifying the data in terms of the themes (to kick-start phase 4). We employed the framework for an analysis of a dataset (n = 785) of facts descriptions from criminal court opinions regarding thefts. The goal of the analysis was to discover classes of typical thefts. Our results show that the LLM, namely OpenAI's GPT-4, generated reasonable initial codes, and it was capable of improving the quality of the codes based on expert feedback. They also suggest that the model performed well in zero-shot classification of facts descriptions in terms of the themes. Finally, the themes autonomously discovered by the LLM appear to map fairly well to the themes arrived at by legal experts. These findings can be leveraged by legal researchers to guide their decisions in integrating LLMs into their thematic analyses, as well as other inductive coding projects.
WCLD: Curated Large Dataset of Criminal Cases from Wisconsin Circuit Courts
Ash, Elliott, Goel, Naman, Li, Nianyun, Marangon, Claudia, Sun, Peiyao
Machine learning based decision-support tools in criminal justice systems are subjects of intense discussions and academic research. There are important open questions about the utility and fairness of such tools. Academic researchers often rely on a few small datasets that are not sufficient to empirically study various real-world aspects of these questions. In this paper, we contribute WCLD, a curated large dataset of 1.5 million criminal cases from circuit courts in the U.S. state of Wisconsin. We used reliable public data from 1970 to 2020 to curate attributes like prior criminal counts and recidivism outcomes. The dataset contains large number of samples from five racial groups, in addition to information like sex and age (at judgment and first offense). Other attributes in this dataset include neighborhood characteristics obtained from census data, detailed types of offense, charge severity, case decisions, sentence lengths, year of filing etc. We also provide pseudo-identifiers for judge, county and zipcode. The dataset will not only enable researchers to more rigorously study algorithmic fairness in the context of criminal justice, but also relate algorithmic challenges with various systemic issues. We also discuss in detail the process of constructing the dataset and provide a datasheet. The WCLD dataset is available at \url{https://clezdata.github.io/wcld/}.
MILDSum: A Novel Benchmark Dataset for Multilingual Summarization of Indian Legal Case Judgments
Datta, Debtanu, Soni, Shubham, Mukherjee, Rajdeep, Ghosh, Saptarshi
Automatic summarization of legal case judgments is a practically important problem that has attracted substantial research efforts in many countries. In the context of the Indian judiciary, there is an additional complexity -- Indian legal case judgments are mostly written in complex English, but a significant portion of India's population lacks command of the English language. Hence, it is crucial to summarize the legal documents in Indian languages to ensure equitable access to justice. While prior research primarily focuses on summarizing legal case judgments in their source languages, this study presents a pioneering effort toward cross-lingual summarization of English legal documents into Hindi, the most frequently spoken Indian language. We construct the first high-quality legal corpus comprising of 3,122 case judgments from prominent Indian courts in English, along with their summaries in both English and Hindi, drafted by legal practitioners. We benchmark the performance of several diverse summarization approaches on our corpus and demonstrate the need for further research in cross-lingual summarization in the legal domain.
Probing LLMs for hate speech detection: strengths and vulnerabilities
Roy, Sarthak, Harshavardhan, Ashish, Mukherjee, Animesh, Saha, Punyajoy
Recently efforts have been made by social media platforms as well as researchers to detect hateful or toxic language using large language models. However, none of these works aim to use explanation, additional context and victim community information in the detection process. We utilise different prompt variation, input information and evaluate large language models in zero shot setting (without adding any in-context examples). We select three large language models (GPT-3.5, text-davinci and Flan-T5) and three datasets - HateXplain, implicit hate and ToxicSpans. We find that on average including the target information in the pipeline improves the model performance substantially (~20-30%) over the baseline across the datasets. There is also a considerable effect of adding the rationales/explanations into the pipeline (~10-20%) over the baseline across the datasets. In addition, we further provide a typology of the error cases where these large language models fail to (i) classify and (ii) explain the reason for the decisions they take. Such vulnerable points automatically constitute 'jailbreak' prompts for these models and industry scale safeguard techniques need to be developed to make the models robust against such prompts.
Goal-Conditioned Predictive Coding for Offline Reinforcement Learning
Zeng, Zilai, Zhang, Ce, Wang, Shijie, Sun, Chen
Recent work has demonstrated the effectiveness of formulating decision making as supervised learning on offline-collected trajectories. Powerful sequence models, such as GPT or BERT, are often employed to encode the trajectories. However, the benefits of performing sequence modeling on trajectory data remain unclear. In this work, we investigate whether sequence modeling has the ability to condense trajectories into useful representations that enhance policy learning. We adopt a two-stage framework that first leverages sequence models to encode trajectory-level representations, and then learns a goal-conditioned policy employing the encoded representations as its input. This formulation allows us to consider many existing supervised offline RL methods as specific instances of our framework. Within this framework, we introduce Goal-Conditioned Predictive Coding (GCPC), a sequence modeling objective that yields powerful trajectory representations and leads to performant policies. Through extensive empirical evaluations on AntMaze, FrankaKitchen and Locomotion environments, we observe that sequence modeling can have a significant impact on challenging decision making tasks. Furthermore, we demonstrate that GCPC learns a goal-conditioned latent representation encoding the future trajectory, which enables competitive performance on all three benchmarks.