Law
TE2Rules: Explaining Tree Ensembles using Rules
Lal, G Roshan, Chen, Xiaotong, Mithal, Varun
Tree Ensemble (TE) models (like Gradient Boosted Trees) often provide higher prediction performance compared to single decision trees. However, TE models generally lack transparency and interpretability, as humans have difficulty understanding their decision logic. This paper presents a novel approach to convert a TE trained for a binary classification task, to a rule list (RL) that closely approximates the TE and is interpretable for a human. This RL can effectively explain the model even on the minority class predicted by the model. Experiments on benchmark datasets demonstrate that, (i) predictions from the RL generated by TE2Rules have higher fidelity (with respect to the original TE) compared to state-of-the-art methods, (ii) the run-time of TE2Rules is comparable to that of some other similar baselines and (iii) the run-time of TE2Rules algorithm can be traded off at the cost of a slightly lower fidelity.
Dilemma of the Artificial Intelligence Regulatory Landscape
When legal regulations get ahead of technological developments, the progress of society may be constrained. Conversely, when technological developments run ahead of legal regulations, unregulated new technologies may harm society, defying technological development's fundamental purpose. This is exactly what has happened in the world in the past decade, as technological developments have far outpaced legal regulations. Worse, traditional legal frameworks focus on the relationship between people, whereas we must develop a legal framework to regulate relations between people and intelligent machines in the current era. Integrating AI technologies into human society imposes unique legal challenges without any precedence.
To Regulate Tech, Nullify Click-Through Contracts
The techlash phenomenon emerged in 2018, as many scandals erupted and Big Tech's reputation took several blows. Surveillance Capitalism was the meme of the day, and the media was hyperventilating about the "ethics crisis" in computing. In response, I wrotea in January 2019, "If society finds the surveillance business model offensive, then the remedy is public policy in the form of laws and regulations, rather than an ethics outrage." The reaction to my call for regulation of technology was a collective shrug. Today's meme is generative AI, and the debate is now about human extinction.
BubbleML: A Multi-Physics Dataset and Benchmarks for Machine Learning
Hassan, Sheikh Md Shakeel, Feeney, Arthur, Dhruv, Akash, Kim, Jihoon, Suh, Youngjoon, Ryu, Jaiyoung, Won, Yoonjin, Chandramowlishwaran, Aparna
In the field of phase change phenomena, the lack of accessible and diverse datasets suitable for machine learning (ML) training poses a significant challenge. Existing experimental datasets are often restricted, with limited availability and sparse ground truth data, impeding our understanding of this complex multiphysics phenomena. To bridge this gap, we present the BubbleML Dataset \footnote{\label{git_dataset}\url{https://github.com/HPCForge/BubbleML}} which leverages physics-driven simulations to provide accurate ground truth information for various boiling scenarios, encompassing nucleate pool boiling, flow boiling, and sub-cooled boiling. This extensive dataset covers a wide range of parameters, including varying gravity conditions, flow rates, sub-cooling levels, and wall superheat, comprising 79 simulations. BubbleML is validated against experimental observations and trends, establishing it as an invaluable resource for ML research. Furthermore, we showcase its potential to facilitate exploration of diverse downstream tasks by introducing two benchmarks: (a) optical flow analysis to capture bubble dynamics, and (b) operator networks for learning temperature dynamics. The BubbleML dataset and its benchmarks serve as a catalyst for advancements in ML-driven research on multiphysics phase change phenomena, enabling the development and comparison of state-of-the-art techniques and models.
Use of LLMs for Illicit Purposes: Threats, Prevention Measures, and Vulnerabilities
Mozes, Maximilian, He, Xuanli, Kleinberg, Bennett, Griffin, Lewis D.
Spurred by the recent rapid increase in the development and distribution of large language models (LLMs) across industry and academia, much recent work has drawn attention to safety- and security-related threats and vulnerabilities of LLMs, including in the context of potentially criminal activities. Specifically, it has been shown that LLMs can be misused for fraud, impersonation, and the generation of malware; while other authors have considered the more general problem of AI alignment. It is important that developers and practitioners alike are aware of security-related problems with such models. In this paper, we provide an overview of existing - predominantly scientific - efforts on identifying and mitigating threats and vulnerabilities arising from LLMs. We present a taxonomy describing the relationship between threats caused by the generative capabilities of LLMs, prevention measures intended to address such threats, and vulnerabilities arising from imperfect prevention measures. With our work, we hope to raise awareness of the limitations of LLMs in light of such security concerns, among both experienced developers and novel users of such technologies.
Regulating Gatekeeper AI and Data: Transparency, Access, and Fairness under the DMA, the GDPR, and beyond
Hacker, Philipp, Cordes, Johann, Rochon, Janina
Artificial intelligence is not only increasingly used in business and administration contexts, but a race for its regulation is also underway, with the EU spearheading the efforts. Contrary to existing literature, this article suggests, however, that the most far-reaching and effective EU rules for AI applications in the digital economy will not be contained in the proposed AI Act - but have just been enacted in the Digital Markets Act. We analyze the impact of the DMA and related EU acts on AI models and their underlying data across four key areas: disclosure requirements; the regulation of AI training data; access rules; and the regime for fair rankings. The paper demonstrates that fairness, in the sense of the DMA, goes beyond traditionally protected categories of non-discrimination law on which scholarship at the intersection of AI and law has so far largely focused on. Rather, we draw on competition law and the FRAND criteria known from intellectual property law to interpret and refine the DMA provisions on fair rankings. Moreover, we show how, based on CJEU jurisprudence, a coherent interpretation of the concept of non-discrimination in both traditional non-discrimination and competition law may be found. The final part sketches specific proposals for a comprehensive framework of transparency, access, and fairness under the DMA and beyond.
The Internet's Next Great Power Suck
In Facebook's youth, most of the website was powered out of a single building in Prineville, Oregon. That data center, holding row upon row of refrigerator-size racks of servers filled with rows of silicon chips, consumed huge amounts of electricity, outstripping the yearly power usage of more than 6,000 American homes. One day in the summer of 2011, as reported in The Register, a Facebook exec received an alarming call: "There's a cloud in the data center … inside." Following an equipment malfunction, the building had become so hot and humid from all the electricity that actual rain, from a literal cloud, briefly drenched the digital one. Now Facebook, or rather Meta, operates well more than a dozen data centers, each much bigger and more powerful than the one in Prineville used to be.
How to Protect Copyright Data in Optimization of Large Language Models?
Chu, Timothy, Song, Zhao, Yang, Chiwun
Large language models (LLMs) and generative AI have played a transformative role in computer research and applications. Controversy has arisen as to whether these models output copyrighted data, which can occur if the data the models are trained on is copyrighted. LLMs are built on the transformer neural network architecture, which in turn relies on a mathematical computation called Attention that uses the softmax function. In this paper, we show that large language model training and optimization can be seen as a softmax regression problem. We then establish a method of efficiently performing softmax regression, in a way that prevents the regression function from generating copyright data. This establishes a theoretical method of training large language models in a way that avoids generating copyright data.
Demographic Parity Constrained Minimax Optimal Regression under Linear Model
We explore the minimax optimal error associated with a demographic parity-constrained regression problem within the context of a linear model. Our proposed model encompasses a broader range of discriminatory bias sources compared to the model presented by Chzhen and Schreuder (2022). Our analysis reveals that the minimax optimal error for the demographic parity-constrained regression problem under our model is characterized by $\Theta(\frac{dM}{n})$, where $n$ denotes the sample size, $d$ represents the dimensionality, and $M$ signifies the number of demographic groups arising from sensitive attributes. Moreover, we demonstrate that the minimax error increases in conjunction with a larger bias present in the model.
GPTEval: A Survey on Assessments of ChatGPT and GPT-4
Mao, Rui, Chen, Guanyi, Zhang, Xulang, Guerin, Frank, Cambria, Erik
The emergence of ChatGPT has generated much speculation in the press about its potential to disrupt social and economic systems. Its astonishing language ability has aroused strong curiosity among scholars about its performance in different domains. There have been many studies evaluating the ability of ChatGPT and GPT-4 in different tasks and disciplines. However, a comprehensive review summarizing the collective assessment findings is lacking. The objective of this survey is to thoroughly analyze prior assessments of ChatGPT and GPT-4, focusing on its language and reasoning abilities, scientific knowledge, and ethical considerations. Furthermore, an examination of the existing evaluation methods is conducted, offering several recommendations for future research in evaluating large language models.