Law
THUIR@COLIEE 2023: Incorporating Structural Knowledge into Pre-trained Language Models for Legal Case Retrieval
Li, Haitao, Su, Weihang, Wang, Changyue, Wu, Yueyue, Ai, Qingyao, Liu, Yiqun
Legal case retrieval techniques play an essential role in modern intelligent legal systems. As an annually well-known international competition, COLIEE is aiming to achieve the state-of-the-art retrieval model for legal texts. This paper summarizes the approach of the championship team THUIR in COLIEE 2023. To be specific, we design structure-aware pre-trained language models to enhance the understanding of legal cases. Furthermore, we propose heuristic pre-processing and post-processing approaches to reduce the influence of irrelevant messages. In the end, learning-to-rank methods are employed to merge features with different dimensions. Experimental results demonstrate the superiority of our proposal. Official results show that our run has the best performance among all submissions. The implementation of our method can be found at https://github.com/CSHaitao/THUIR-COLIEE2023.
Making Intelligence: Ethical Values in IQ and ML Benchmarks
Blili-Hamelin, Borhane, Hancox-Li, Leif
In recent years, ML researchers have wrestled with defining and improving machine learning (ML) benchmarks and datasets. In parallel, some have trained a critical lens on the ethics of dataset creation and ML research. In this position paper, we highlight the entanglement of ethics with seemingly ``technical'' or ``scientific'' decisions about the design of ML benchmarks. Our starting point is the existence of multiple overlooked structural similarities between human intelligence benchmarks and ML benchmarks. Both types of benchmarks set standards for describing, evaluating, and comparing performance on tasks relevant to intelligence -- standards that many scholars of human intelligence have long recognized as value-laden. We use perspectives from feminist philosophy of science on IQ benchmarks and thick concepts in social science to argue that values need to be considered and documented when creating ML benchmarks. It is neither possible nor desirable to avoid this choice by creating value-neutral benchmarks. Finally, we outline practical recommendations for ML benchmark research ethics and ethics review.
Assessing Trustworthiness of Autonomous Systems
Chance, Gregory, Abeywickrama, Dhaminda B., LeClair, Beckett, Kerr, Owen, Eder, Kerstin
As Autonomous Systems (AS) become more ubiquitous in society, more responsible for our safety and our interaction with them more frequent, it is essential that they are trustworthy. Assessing the trustworthiness of AS is a mandatory challenge for the verification and development community. This will require appropriate standards and suitable metrics that may serve to objectively and comparatively judge trustworthiness of AS across the broad range of current and future applications. The meta-expression `trustworthiness' is examined in the context of AS capturing the relevant qualities that comprise this term in the literature. Recent developments in standards and frameworks that support assurance of autonomous systems are reviewed. A list of key challenges are identified for the community and we present an outline of a process that can be used as a trustworthiness assessment framework for AS.
Is it too late to regulate AI to keep it from outsmarting the human race?
Scammers are texting victims and stealing their information by posing as legitimate businesses or agencies. CyberGuy explains how to stay safe. Remember the good ol' days when our biggest worry was accidentally pocket-dialing someone? Well, times have changed, and so has technology. We now have these nifty AI systems that can do everything from making restaurant reservations to driving our cars.
OpenAI suggests voluntary AI standards, not government mandates, to ensure AI safety
Fox News contributor Joe Concha joins "Fox & Friends First" to discuss Elon Musk's warning that AI could threaten elections and his concerns on the declining birth rate. The top lawyer for OpenAI, the company that developed ChatGPT, argued that the best way to regulate artificial intelligence is not to start with government mandated rules and regulations but to allow the companies themselves to set standards that ensure AI is used safely and responsibly. OpenAI General Counsel Jason Kwon made that argument during a Tuesday panel discussion in Washington, D.C., which was hosted by BSA/The Software Alliance, even as he acknowledged that AI is developing so quickly that it can often lead to unexpected results that companies quickly need to rein in. Still, when asked what his message to policymakers was, Kwon recommended voluntary, industry-led standards for AI, calling for a tactic that many companies in most industries tend to favor over government mandates. The top lawyer at OpenAI, run by CEO Sam Altman, above, said this week that the company recommends voluntary industry standards to regulate AI, not government mandates.
AI will be the political left's 'single greatest weapon' against religious faith and truth, says expert
Angie Wisdom and Dr. Chirag Shah discuss how artificial intelligence could play a role in online and professional relationships. As national conversations around artifical intelligence (AI) intensify, faith leaders and scholars are examining the potential ramifications these emerging technologies will have on worship – both its practice and its role in modern life. Some experts and faith leaders are also concerned about whether religion will have any place in AI programming – or if the intellectual will eventually take precedence over the spiritual in society. It's possible and even probable, say experts. Dan Schneider, Media Research Center and Free Speech America vice president, is both blunt and emphatic in his assessment of AI. "The [political] left controls AI, and the left is going to what the left wants to do," Schneider, whose headquarters are in Reston, Virginia, told Fox News Digital in a recent phone interview.
Web Content Filtering through knowledge distillation of Large Language Models
Vörös, Tamás, Bergeron, Sean Paul, Berlin, Konstantin
We introduce a state-of-the-art approach for URL categorization that leverages the power of Large Language Models (LLMs) to address the primary objectives of web content filtering: safeguarding organizations from legal and ethical risks, limiting access to high-risk or suspicious websites, and fostering a secure and professional work environment. Our method utilizes LLMs to generate accurate classifications and then employs established knowledge distillation techniques to create smaller, more specialized student models tailored for web content filtering. Distillation results in a student model with a 9% accuracy rate improvement in classifying websites, sourced from customer telemetry data collected by a large security vendor, into 30 distinct content categories based on their URLs, surpassing the current state-of-the-art approach. Our student model matches the performance of the teacher LLM with 175 times less parameters, allowing the model to be used for in-line scanning of large volumes of URLs, and requires 3 orders of magnitude less manually labeled training data than the current state-of-the-art approach. Depending on the specific use case, the output generated by our approach can either be directly returned or employed as a pre-filter for more resource-intensive operations involving website images or HTML.
Can GPT-3 Perform Statutory Reasoning?
Blair-Stanek, Andrew, Holzenberger, Nils, Van Durme, Benjamin
Statutory reasoning is the task of reasoning with facts and statutes, which are rules written in natural language by a legislature. It is a basic legal skill. In this paper we explore the capabilities of the most capable GPT-3 model, text-davinci-003, on an established statutory-reasoning dataset called SARA. We consider a variety of approaches, including dynamic few-shot prompting, chain-of-thought prompting, and zero-shot prompting. While we achieve results with GPT-3 that are better than the previous best published results, we also identify several types of clear errors it makes. We investigate why these errors happen. We discover that GPT-3 has imperfect prior knowledge of the actual U.S. statutes on which SARA is based. More importantly, we create simple synthetic statutes, which GPT-3 is guaranteed not to have seen during training. We find GPT-3 performs poorly at answering straightforward questions about these simple synthetic statutes.
The Case for Protecting AI-Generated Speech With the First Amendment
The modern foundation of the free speech clause of the First Amendment is the concept of the marketplace of ideas. The notion comes from John Stuart Mill who first drew the analogy to a market where ideas compete freely with one another and people form their own judgments. The analogy was first noted in Justice Oliver Wendell Holmes' famous dissent in Abrams v. United States (1919) when he wrote, "The best test of truth is the power of the thought to get itself accepted in the competition of the market." This free and open market of ideas is considered vital to the function and preservation of democracy. As Holmes wrote in another famous dissent in United States v. Schwimmer (1929), "If there is any principle of the Constitution that more imperatively calls for attachment than any other, it is the principle of free thought--not free thought for those who agree with us freedom for the thought we hate." Until recently, the Supreme Court had not cared much where those thoughts might come from, or whether their source must be human.
3 ways Bud Light disaster ends, Kamala's artificial intelligence problem and more Fox News Opinion
Fox News host Sean Hannity gives his take on the Biden family's questionable business dealings on'Hannity.' TURNING BACK THE CLOCK – I'm a doctor and my Black parents saw me break free of segregation. BRIAN MAST – Joe Biden is abusing veterans like me to boost this key policy… Continue reading… JONATHAN TURLEY – Joe Biden says Hunter has done'nothing wrong.' VIDEO OF THE DAY – Fox News host Laura Ingraham explains why Democrats want to focus on gun control instead of inflation and the economy heading into 2024 … Watch now... PUFF, PUFF, PASS – This is America's surprising youth drug crisis… Continue reading… JUST SAY NO – California Reparations: Great-granddaughter of racism victim in Golden State says no. Here's why… Continue reading… FIGHTING HARD – Biden's bizarre view of women's sports puts female athletes at risk… Continue reading… COMER – Biden family was dealing with'very bad actors in very bad countries'… See the video… PUFFBALL PRESS – Liberal media continues to bury Hunter Biden's horrible behavior around daughter Navy Joan… Continue reading…