Goto

Collaborating Authors

 Law


Interpreting Deep Neural Networks with the Package innsight

arXiv.org Artificial Intelligence

The R package innsight offers a general toolbox for revealing variable-wise interpretations of deep neural networks' predictions with so-called feature attribution methods. Aside from the unified and user-friendly framework, the package stands out in three ways: It is generally the first R package implementing feature attribution methods for neural networks. Secondly, it operates independently of the deep learning library allowing the interpretation of models from any R package, including keras, torch, neuralnet, and even custom models. Despite its flexibility, innsight benefits internally from the torch package's fast and efficient array calculations, which builds on LibTorch $-$ PyTorch's C++ backend $-$ without a Python dependency. Finally, it offers a variety of visualization tools for tabular, signal, image data or a combination of these. Additionally, the plots can be rendered interactively using the plotly package.


Secure Summation via Subset Sums: A New Primitive for Privacy-Preserving Distributed Machine Learning

arXiv.org Artificial Intelligence

For population studies or for the training of complex machine learning models, it is often required to gather data from different actors. In these applications, summation is an important primitive: for computing means, counts or mini-batch gradients. In many cases, the data is privacysensitive and therefore cannot be collected on a central server. Hence the summation needs to be performed in a distributed and privacy-preserving way. Existing solutions for distributed summation with computational privacy guarantees make trust or connection assumptions -- e.g., the existence of a trusted server or peer-to-peer connections between clients -- that might not be fulfilled in real world settings. Motivated by these challenges, we propose Secure Summation via Subset Sums (S5), a method for distributed summation that works in the presence of a malicious server and only two honest clients, and without the need for peer-to-peer connections between clients. S5 adds zero-sum noise to clients' messages and shuffles them before sending them to the aggregating server. Our main contribution is a proof that this scheme yields a computational privacy guarantee based on the multidimensional subset sum problem. Our analysis of this problem may be of independent interest for other privacy and cryptography applications.


Deceptive AI Ecosystems: The Case of ChatGPT

arXiv.org Artificial Intelligence

ChatGPT, an AI chatbot, has gained popularity for its capability in generating human-like responses. However, this feature carries several risks, most notably due to its deceptive behaviour such as offering users misleading or fabricated information that could further cause ethical issues. To better understand the impact of ChatGPT on our social, cultural, economic, and political interactions, it is crucial to investigate how ChatGPT operates in the real world where various societal pressures influence its development and deployment. This paper emphasizes the need to study ChatGPT "in the wild", as part of the ecosystem it is embedded in, with a strong focus on user involvement. We examine the ethical challenges stemming from ChatGPT's deceptive human-like interactions and propose a roadmap for developing more transparent and trustworthy chatbots. Central to our approach is the importance of proactive risk assessment and user participation in shaping the future of chatbot technology.


Should ChatGPT and Bard Share Revenue with Their Data Providers? A New Business Model for the AI Era

arXiv.org Artificial Intelligence

With various AI tools such as ChatGPT becoming increasingly popular, we are entering a true AI era. We can foresee that exceptional AI tools will soon reap considerable profits. A crucial question arise: should AI tools share revenue with their training data providers in additional to traditional stakeholders and shareholders? The answer is Yes. Large AI tools, such as large language models, always require more and better quality data to continuously improve, but current copyright laws limit their access to various types of data. Sharing revenue between AI tools and their data providers could transform the current hostile zero-sum game relationship between AI tools and a majority of copyrighted data owners into a collaborative and mutually beneficial one, which is necessary to facilitate the development of a virtuous cycle among AI tools, their users and data providers that drives forward AI technology and builds a healthy AI ecosystem. However, current revenue-sharing business models do not work for AI tools in the forthcoming AI era, since the most widely used metrics for website-based traffic and action, such as clicks, will be replaced by new metrics such as prompts and cost per prompt for generative AI tools. A completely new revenue-sharing business model, which must be almost independent of AI tools and be easily explained to data providers, needs to establish a prompt-based scoring system to measure data engagement of each data provider. This paper systematically discusses how to build such a scoring system for all data providers for AI tools based on classification and content similarity models, and outlines the requirements for AI tools or third parties to build it. Sharing revenue with data providers using such a scoring system would encourage more data owners to participate in the revenue-sharing program. This will be a utilitarian AI era where all parties benefit.


Expert argues against federal AI agency despite growing momentum for idea on Capitol Hill

FOX News

Center for A.I. Safety Director Dan Hendrycks explains concerns about how the rapid growth of artificial intelligence could impact society. People need to change how they're thinking about regulating artificial intelligence, according to a prominent expert in the field, who pushed back on an idea gaining traction among lawmakers to create a new government agency to regulate AI. "Regulation is a really hard question," Andres Sawicki, a professor of law and director of the business of innovation, law, and technology (BILT) concentration at the University of Miami, told Fox News Digital. "The topic of AI is too big to be handled in one big coherent manner." Rather than tackling AI in a sweeping, comprehensive way, Sawicki recommend a more pragmatic, piecemeal approach. "Look specifically and concretely at effects the technology is having, the impact of AI on this or that issue. There shouldn't be a Department of AI to handle this in one big swoop."


Congress is racing to regulate AI. Silicon Valley is eager to teach them how.

Washington Post - Technology News

Other industry leaders are taking a different tact, blitzing Congress with their vision for how Washington should regulate their companies. Altman in May had private meetings and a dinner with lawmakers, where he demonstrated -- to their amusement -- how ChatGPT could write a speech for them to deliver on the chamber floor. Smith has given legislators a lesson on the technical stack that underpins generative AI models like ChatGPT, including computing infrastructure and applications. And Smith recently unveiled his blueprint for AI regulation at a speech in Washington attended by half a dozen lawmakers.


Deep Huber quantile regression networks

arXiv.org Artificial Intelligence

Typical machine learning regression applications aim to report the mean or the median of the predictive probability distribution, via training with a squared or an absolute error scoring function. The importance of issuing predictions of more functionals of the predictive probability distribution (quantiles and expectiles) has been recognized as a means to quantify the uncertainty of the prediction. In deep learning (DL) applications, that is possible through quantile and expectile regression neural networks (QRNN and ERNN respectively). Here we introduce deep Huber quantile regression networks (DHQRN) that nest QRNNs and ERNNs as edge cases. DHQRN can predict Huber quantiles, which are more general functionals in the sense that they nest quantiles and expectiles as limiting cases. The main idea is to train a deep learning algorithm with the Huber quantile regression function, which is consistent for the Huber quantile functional. As a proof of concept, DHQRN are applied to predict house prices in Australia. In this context, predictive performances of three DL architectures are discussed along with evidential interpretation of results from an economic case study.


KEST: Kernel Distance Based Efficient Self-Training for Improving Controllable Text Generation

arXiv.org Artificial Intelligence

Self-training (ST) has come to fruition in language understanding tasks by producing pseudo labels, which reduces the labeling bottleneck of language model fine-tuning. Nevertheless, in facilitating semi-supervised controllable language generation, ST faces two key challenges. First, augmented by self-generated pseudo text, generation models tend to over-exploit the previously learned text distribution, suffering from mode collapse and poor generation diversity. Second, generating pseudo text in each iteration is time-consuming, severely decelerating the training process. In this work, we propose KEST, a novel and efficient self-training framework to handle these problems. KEST utilizes a kernel-based loss, rather than standard cross entropy, to learn from the soft pseudo text produced by a shared non-autoregressive generator. We demonstrate both theoretically and empirically that KEST can benefit from more diverse pseudo text in an efficient manner, which allows not only refining and exploiting the previously fitted distribution but also enhanced exploration towards a larger potential text space, providing a guarantee of improved performance. Experiments on three controllable generation tasks demonstrate that KEST significantly improves control accuracy while maintaining comparable text fluency and generation diversity against several strong baselines.


Deep Intellectual Property Protection: A Survey

arXiv.org Artificial Intelligence

Deep Neural Networks (DNNs), from AlexNet to ResNet to ChatGPT, have made revolutionary progress in recent years, and are widely used in various fields. The high performance of DNNs requires a huge amount of high-quality data, expensive computing hardware, and excellent DNN architectures that are costly to obtain. Therefore, trained DNNs are becoming valuable assets and must be considered the Intellectual Property (IP) of the legitimate owner who created them, in order to protect trained DNN models from illegal reproduction, stealing, redistribution, or abuse. Although being a new emerging and interdisciplinary field, numerous DNN model IP protection methods have been proposed. Given this period of rapid evolution, the goal of this paper is to provide a comprehensive survey of two mainstream DNN IP protection methods: deep watermarking and deep fingerprinting, with a proposed taxonomy. More than 190 research contributions are included in this survey, covering many aspects of Deep IP Protection: problem definition, main threats and challenges, merits and demerits of deep watermarking and deep fingerprinting methods, evaluation metrics, and performance discussion. We finish the survey by identifying promising directions for future research.


Texas AG subpoenas Pfizer to release Meta ad records

Engadget

The office of Texas State Attorney General Ken Paxton has requested that Pfizer and several other companies turn over advertising data tied to the social media giant Meta. The lawsuit was filed after consumer data privacy concerns were raised by the state in its latest legal battle with Meta, according to a report by Law360. The Texas Attorney General claims that millions of Texas residents have had their private biometric data misappropriated over the past ten years. The order requires the vaccine maker to share any records it holds regarding Meta's use of facial recognition technology over claims that the company was collecting biometric data from Facebook users without their consent. This decree over Pfizer's records follows a February 2022 filing against Meta by the Texas Attorney General that claimed "Facebook knowingly captured biometric information for its own commercial benefit" in order to "train and improve" its in-house facial recognition technology powered by AI.