Goto

Collaborating Authors

 Law


Contestable AI needs Computational Argumentation

arXiv.org Artificial Intelligence

AI has become pervasive in recent years, but state-of-the-art approaches predominantly neglect the need for AI systems to be contestable. Instead, contestability is advocated by AI guidelines (e.g. by the OECD) and regulation of automated decision-making (e.g. GDPR). In this position paper we explore how contestability can be achieved computationally in and for AI. We argue that contestable AI requires dynamic (human-machine and/or machine-machine) explainability and decision-making processes, whereby machines can (i) interact with humans and/or other machines to progressively explain their outputs and/or their reasoning as well as assess grounds for contestation provided by these humans and/or other machines, and (ii) revise their decision-making processes to redress any issues successfully raised during contestation. Given that much of the current AI landscape is tailored to static AIs, the need to accommodate contestability will require a radical rethinking, that, we argue, computational argumentation is ideally suited to support.


Research on Splicing Image Detection Algorithms Based on Natural Image Statistical Characteristics

arXiv.org Artificial Intelligence

Abstract:With the development and widespread application of digital image processing technology, image splicing has become a common method of image manipulation, raising numerous security and legal issues. This paper introduces a new splicing image detection algorithm based on the statistical characteristics of natural images, aimed at improving the accuracy and efficiency of splicing image detection. By analyzing the limitations of traditional methods, we have developed a detection framework that integrates advanced statistical analysis techniques and machine learning methods. The algorithm has been validated using multiple public datasets, showing high accuracy in detecting spliced edges and locating tampered areas, as well as good robustness. Additionally, we explore the potential applications and challenges faced by the algorithm in real-world scenarios. This research not only provides an effective technological means for the field of image tampering detection but also offers new ideas and methods for future related research.


Addressing the Regulatory Gap: Moving Towards an EU AI Audit Ecosystem Beyond the AIA by Including Civil Society

arXiv.org Artificial Intelligence

The European legislature has proposed the Digital Services Act (DSA) and Artificial Intelligence Act (AIA) to regulate platforms and Artificial Intelligence (AI) products. We review to what extent third-party audits are part of both laws and to what extent access to models and data is provided. By considering the value of third-party audits and third-party data access in an audit ecosystem, we identify a regulatory gap in that the Artificial Intelligence Act does not provide access to data for researchers and civil society. Our contributions to the literature include: (1) Defining an AI audit ecosystem that incorporates compliance and oversight. (2) Highlighting a regulatory gap within the DSA and AIA regulatory framework, preventing the establishment of an AI audit ecosystem. (3) Emphasizing that third-party audits by research and civil society must be part of that ecosystem and demand that the AIA include data and model access for certain AI products. We call for the DSA to provide NGOs and investigative journalists with data access to platforms by delegated acts and for adaptions and amendments of the AIA to provide third-party audits and data and model access at least for high-risk systems to close the regulatory gap. Regulations modeled after European Union AI regulations should enable data access and third-party audits, fostering an AI audit ecosystem that promotes compliance and oversight mechanisms.


Training Compute Thresholds: Features and Functions in AI Governance

arXiv.org Artificial Intelligence

Compute thresholds offer several advantages that are difficult to achieve with other metrics, making them a useful complement (Section 3): Risk-tracking: Higher training compute is associated with greater model capabilities and potential risks. Quantifiability and ease of measurement: Training compute is a quantifiable metric that is relatively straightforward and cost-effective to calculate. Difficulty of circumvention: Reducing training compute to evade regulation is likely to simultaneously reduce a model's capabilities and risks. Knowable before development and deployment: Training compute can be estimated prior to a model's development and deployment, facilitating proactive measures. External verifiability: Compute usage can potentially be verified by external parties without compromising sensitive information. Targeted regulatory scope: The metric is proportionately higher for models that cost more to develop, minimizing the burden on smaller actors while focusing on the most well-resourced ones. Regulation of frontier models based on compute thresholds is primarily concerned with ensuring government visibility and the capacity to act if these models are found to present serious societal-scale risks. It is not intended to address all possible downstream impacts of AI on society, many of which should be regulated at the use level.


Safety in Graph Machine Learning: Threats and Safeguards

arXiv.org Artificial Intelligence

Abstract--Graph Machine Learning (Graph ML) has witnessed substantial advancements in recent years. With their remarkable ability to process graph-structured data, Graph ML techniques have been extensively utilized across diverse applications, including critical domains like finance, healthcare, and transportation. Despite their societal benefits, recent research highlights significant safety concerns associated with the widespread use of Graph ML models. Lacking safety-focused designs, these models can produce unreliable predictions, demonstrate poor generalizability, and compromise data confidentiality. In high-stakes scenarios such as financial fraud detection, these vulnerabilities could jeopardize both individuals and society at large. Therefore, it is imperative to prioritize the development of safety-oriented Graph ML models to mitigate these risks and enhance public confidence in their applications. In this survey paper, we explore three critical aspects vital for enhancing safety in Graph ML: reliability, generalizability, and confidentiality. We categorize and analyze threats to each aspect under three headings: model threats, data threats, and attack threats. This novel taxonomy guides our review of effective strategies to protect against these threats. Our systematic review lays a groundwork for future research aimed at developing practical, safety-centered Graph ML models. Furthermore, we highlight the significance of safe Graph ML practices and suggest promising avenues for further investigation in this crucial area. To prevalent across a wide range of real-world applications, narrow this gap, our survey seeks to resolve two critical including drug discovery [15], traffic forecasting questions: (1) What are the key aspects involved in the safety [76], and disease diagnosis [96]. Within these domains, issues of Graph ML? (2) What specific types of threats might Graph Machine Learning (Graph ML) plays a pivotal role in arise within each aspect, and how can they be effectively modeling this data and executing graph-based predictive handled? To address the first question, we introduce a novel tasks [83], [187]. However, as the scope of Graph ML taxonomy that facilitates a thorough categorization of safety applications expands, concerns about their underlying safety issues in Graph ML. To answer the second question, we issues intensify [37].


The Future of Large Language Model Pre-training is Federated

arXiv.org Artificial Intelligence

Generative pre-trained large language models (LLMs) have demonstrated impressive performance over a wide range of tasks, thanks to the unprecedented amount of data they have been trained on. As established scaling laws indicate, LLMs' future performance improvement depends on the amount of computing and data sources we can leverage for pre-training. Federated learning (FL) has the potential to unleash the majority of the planet's data and computational resources, which are underutilized by the data-center-focused training methodology of current LLM practice. Our work presents a robust, flexible, reproducible FL approach that enables large-scale collaboration across institutions to train LLMs. This would mobilize more computational and data resources while matching or potentially exceeding centralized performance. We further show the effectiveness of the federated training scales with model size and present our approach for training a billion-scale federated LLM using limited resources. This will help data-rich actors to become the protagonists of LLMs pre-training instead of leaving the stage to compute-rich actors alone.


Challenging the Human-in-the-loop in Algorithmic Decision-making

arXiv.org Artificial Intelligence

We discuss the role of humans in algorithmic decision-making (ADM) for socially relevant problems from a technical and philosophical perspective. In particular, we illustrate tensions arising from diverse expectations, values, and constraints by and on the humans involved. To this end, we assume that a strategic decision-maker (SDM) introduces ADM to optimize strategic and societal goals while the algorithms' recommended actions are overseen by a practical decision-maker (PDM) - a specific human-in-the-loop - who makes the final decisions. While the PDM is typically assumed to be a corrective, it can counteract the realization of the SDM's desired goals and societal values not least because of a misalignment of these values and unmet information needs of the PDM. This has significant implications for the distribution of power between the stakeholders in ADM, their constraints, and information needs. In particular, we emphasize the overseeing PDM's role as a potential political and ethical decision maker, who acts expected to balance strategic, value-driven objectives and on-the-ground individual decisions and constraints. We demonstrate empirically, on a machine learning benchmark dataset, the significant impact an overseeing PDM's decisions can have even if the PDM is constrained to performing only a limited amount of actions differing from the algorithms' recommendations. To ensure that the SDM's intended values are realized, the PDM needs to be provided with appropriate information conveyed through tailored explanations and its role must be characterized clearly. Our findings emphasize the need for an in-depth discussion of the role and power of the PDM and challenge the often-taken view that just including a human-in-the-loop in ADM ensures the 'correct' and 'ethical' functioning of the system.


This Site Changed Digital Art Forever. Now It's a Ghost Town.

Slate

On March 27, a large group of artists and creators from across the web noticed the frightening extent to which a once-beloved, highly influential community platform of theirs had, like so many others, fallen prey to the artificial intelligence juggernauts plundering the internet. As VFX animator Romain Revert (Minions, The Lorax) pointed out on X, the bots had come for his old home base of DeviantArt. Its social accounts were promoting "top sellers" on the platform, with usernames like "Isaris-AI" and "Mikonotai," who reportedly made tens of thousands of dollars through bulk sales of autogenerated, dead-eyed 3D avatars. The sales weren't exactly legit--an online artist known as WyerframeZ looked at those users' followers and found pages of profiles with repeated names, overlapping biographies and account-creation dates, and zero creations of their own, making it apparent that various bots were involved in these "purchases." It's not unlikely, as WyerframeZ surmised, that someone constructed a low-effort bot network that could hold up a self-perpetuating money-embezzlement scheme: Generate a bunch of free images and accounts, have them buy and boost one another in perpetuity, inflate metrics so that the "art" gets boosted by DeviantArt and reaches real humans, then watch the money pile up from DeviantArt revenue-sharing programs. After Revert declared this bot-on-bot fest to be "the downfall of DeviantArt," myriad other artists and longtime users of the platform chimed in to share in the outrage that these artificial accounts were monopolizing DeviantArt's promotional and revenue apparatuses.


Microsoft's AI obsession is destroying the company's climate goals

PCWorld

Technology giant Microsoft recently released its sustainability report for the 2023 financial year, and it didn't exactly have positive numbers. Microsoft set a climate goal in 2020 to become carbon negative by 2030, sequestering more carbon dioxide from the atmosphere than it emits, but the company seems to be on the wrong track to achieve this goal. Microsoft's greenhouse gas emissions increased by 30 percent in the 2023 financial year -- and it's all Copilot's fault. The big culprit is the company's huge AI investments. It takes huge amounts of energy to train and use AI models.


Microsoft's AI push imperils climate goal as carbon emissions jump

The Japan Times

When Microsoft pledged four years ago to remove more carbon than it emits by the end of the decade, it was one of the most ambitious and comprehensive plans to tackle climate change. Now the software giant's relentless push to be the global leader in artificial intelligence is putting that goal in peril. The Seattle-based company's total planet-warming impact is about 30% higher today than it was in 2020, according to the latest sustainability report published Wednesday. That makes getting to below zero by 2030 even harder than it was when it announced its carbon-negative goal. Now to meet its goals, the software giant will have to make serious progress very quickly in gaining access to green steel and concrete and less carbon-intensive chips, said Brad Smith, president of Microsoft, in an exclusive interview with Bloomberg Green.