Goto

Collaborating Authors

 Generative AI


Federated Learning for Non-factorizable Models using Deep Generative Prior Approximations

arXiv.org Machine Learning

Federated learning (FL) allows for collaborative model training across decentralized clients while preserving privacy by avoiding data sharing. However, current FL methods assume conditional independence between client models, limiting the use of priors that capture dependence, such as Gaussian processes (GPs). We introduce the Structured Independence via deep Generative Model Approximation (SIGMA) prior which enables FL for non-factorizable models across clients, expanding the applicability of FL to fields such as spatial statistics, epidemiology, environmental science, and other domains where modeling dependencies is crucial. The SIGMA prior is a pre-trained deep generative model that approximates the desired prior and induces a specified conditional independence structure in the latent variables, creating an approximate model suitable for FL settings. We demonstrate the SIGMA prior's effectiveness on synthetic data and showcase its utility in a real-world example of FL for spatial data, using a conditional autoregressive prior to model spatial dependence across Australia. Our work enables new FL applications in domains where modeling dependent data is essential for accurate predictions and decision-making.


Media Companies Are Making a Huge Mistake With AI

The Atlantic - Technology

In 2011, I sat in the Guggenheim Museum in New York and watched Rupert Murdoch announce the beginning of a "new digital renaissance" for news. The newspaper mogul was unveiling an iPad-inspired publication called The Daily. "The iPad demands that we completely reimagine our craft," he said. The Daily shut down the following year, after burning through a reported 40 million. For as long as I have reported on internet companies, I have watched news leaders try to bend their businesses to the will of Apple, Google, Meta, and more.


Human-Centered Automation

arXiv.org Artificial Intelligence

The rapid advancement of Generative Artificial Intelligence (AI), such as Large Language Models (LLMs) and Multimodal Large Language Models (MLLM), has the potential to revolutionize the way we work and interact with digital systems across various industries. However, the current state of software automation, such as Robotic Process Automation (RPA) frameworks, often requires domain expertise and lacks visibility and intuitive interfaces, making it challenging for users to fully leverage these technologies. This position paper argues for the emerging area of Human-Centered Automation (HCA), which prioritizes user needs and preferences in the design and development of automation systems. Drawing on empirical evidence from human-computer interaction research and case studies, we highlight the importance of considering user perspectives in automation and propose a framework for designing human-centric automation solutions. The paper discusses the limitations of existing automation approaches, the challenges in integrating AI and RPA, and the benefits of human-centered automation for productivity, innovation, and democratizing access to these technologies. We emphasize the importance of open-source solutions and provide examples of how HCA can empower individuals and organizations in the era of rapidly progressing AI, helping them remain competitive. The paper also explores pathways to achieve more advanced and context-aware automation solutions. We conclude with a call to action for researchers and practitioners to focus on developing automation technologies that adapt to user needs, provide intuitive interfaces, and leverage the capabilities of high-end AI to create a more accessible and user-friendly future of automation.


When Generative AI Meets Workplace Learning: Creating A Realistic & Motivating Learning Experience With A Generative PCA

arXiv.org Artificial Intelligence

Workplace learning is used to train employees systematically, e.g., via e-learning or in 1:1 training. However, this is often deemed ineffective and costly. Whereas pure e-learning lacks the possibility of conversational exercise and personal contact, 1:1 training with human instructors involves a high level of personnel and organizational costs. Hence, pedagogical conversational agents (PCAs), based on generative AI, seem to compensate for the disadvantages of both forms. Following Action Design Research, this paper describes an organizational communication training with a Generative PCA (GenPCA). The evaluation shows promising results: the agent was perceived positively among employees and contributed to an improvement in self-determined learning. However, the integration of such agent comes not without limitations. We conclude with suggestions concerning the didactical methods, which are supported by a GenPCA, and possible improvements of such an agent for workplace learning.


Unlearning Concepts in Diffusion Model via Concept Domain Correction and Concept Preserving Gradient

arXiv.org Artificial Intelligence

Current text-to-image diffusion models have achieved groundbreaking results in image generation tasks. However, the unavoidable inclusion of sensitive information during pre-training introduces significant risks such as copyright infringement and privacy violations in the generated images. Machine Unlearning (MU) provides a effective way to the sensitive concepts captured by the model, has been shown to be a promising approach to addressing these issues. Nonetheless, existing MU methods for concept erasure encounter two primary bottlenecks: 1) generalization issues, where concept erasure is effective only for the data within the unlearn set, and prompts outside the unlearn set often still result in the generation of sensitive concepts; and 2) utility drop, where erasing target concepts significantly degrades the model's performance. To this end, this paper first proposes a concept domain correction framework for unlearning concepts in diffusion models. By aligning the output domains of sensitive concepts and anchor concepts through adversarial training, we enhance the generalizability of the unlearning results. Secondly, we devise a concept-preserving scheme based on gradient surgery. This approach alleviates the parts of the unlearning gradient that contradict the relearning gradient, ensuring that the process of unlearning minimally disrupts the model's performance. Finally, extensive experiments validate the effectiveness of our model, demonstrating our method's capability to address the challenges of concept unlearning in diffusion models while preserving model utility.


The Impact and Opportunities of Generative AI in Fact-Checking

arXiv.org Artificial Intelligence

Generative AI appears poised to transform white collar professions, with more than 90% of Fortune 500 companies using OpenAI's flagship GPT models, which have been characterized as "general purpose technologies" capable of effecting epochal changes in the economy. But how will such technologies impact organizations whose job is to verify and report factual information, and to ensure the health of the information ecosystem? To investigate this question, we conducted 30 interviews with N=38 participants working at 29 fact-checking organizations across six continents, asking about how they use generative AI and the opportunities and challenges they see in the technology. We found that uses of generative AI envisioned by fact-checkers differ based on organizational infrastructure, with applications for quality assurance in Editing, for trend analysis in Investigation, and for information literacy in Advocacy. We used the TOE framework to describe participant concerns ranging from the Technological (lack of transparency), to the Organizational (resource constraints), to the Environmental (uncertain and evolving policy). Building on the insights of our participants, we describe value tensions between fact-checking and generative AI, and propose a novel Verification dimension to the design space of generative models for information verification work. Finally, we outline an agenda for fairness, accountability, and transparency research to support the responsible use of generative AI in fact-checking. Throughout, we highlight the importance of human infrastructure and labor in producing verified information in collaboration with AI. We expect that this work will inform not only the scientific literature on fact-checking, but also contribute to understanding of organizational adaptation to a powerful but unreliable new technology.


Near to Mid-term Risks and Opportunities of Open-Source Generative AI

arXiv.org Artificial Intelligence

In the next few years, applications of Generative AI are expected to revolutionize a number of different areas, ranging from science & medicine to education. The potential for these seismic changes has triggered a lively debate about potential risks and resulted in calls for tighter regulation, in particular from some of the major tech companies who are leading in AI development. This regulation is likely to put at risk the budding field of open-source Generative AI. We argue for the responsible open sourcing of generative AI models in the near and medium term. To set the stage, we first introduce an AI openness taxonomy system and apply it to 40 current large language models. We then outline differential benefits and risks of open versus closed source AI and present potential risk mitigation, ranging from best practices to calls for technical and scientific contributions. We hope that this report will add a much needed missing voice to the current public discourse on near to mid-term AI safety and other societal impact.


Reports of the Association for the Advancement of Artificial Intelligence's 2024 Spring Symposium Series

Interactive AI Magazine

The substance of the symposium addressed the challenges in creating synergistic human and AI-based autonomous systems-of-systems. Recent advances in generative AI techniques (e.g., LLMs) have exacerbated the growing concerns associated with AI, held by researchers and the public alike, such as the risk, trust, ethics, and safety to the users and to the public from the operations of autonomous machines/AI alone in open situations. These concerns present major hurdles in the development of verified and validated engineered systems involving bi-directional pathways across the human-machine barrier; in this context, bi-directionality means understanding the design and operational consequences that the human may have on machine agents and the effects that machine or AI agents may have on humans. Current discussions on human-AI/machine interactions are unresolved or fragmented, focusing either on the impact that AI or machines may have on human stakeholders (including the relevant human factor considerations) or potential ways of involving humans or machines in computational or physical interventions (e.g., data annotations, human-machine behavior interpretations, operator-machine interventions). We believe the challenges associated with human-AI/machine collaborative systems cannot be adequately addressed if the underlying challenges associated with bi-directionality are not fully identified and taken into consideration.


The Download: Nick Clegg on electoral misinformation, and AI's carbon footprint

MIT Technology Review

Meta has seen strikingly little AI-generated misinformation around the 2024 elections despite major votes in countries such as Indonesia, Taiwan, and Bangladesh, said the company's president of global affairs, Nick Clegg, on Wednesday. "The interesting thing so far--I stress, so far--is not how much but how little AI-generated content [there is]," said Clegg during an interview at MIT Technology Review's EmTech Digital conference in Cambridge, Massachusetts. As voters will head to polls this year in more than 50 countries, experts have raised the alarm over AI-generated political disinformation and the prospect that malicious actors will use generative AI and social media to interfere with elections. And even well-resourced tech giants like Meta are struggling to keep up. How generative AI is boosting the spread of disinformation and propaganda.


OpenAI Should Have Gone Way Beyond Scarlett Johansson

The Atlantic - Technology

This article was featured in the One Story to Read Today newsletter. Let's get this out of the way: OpenAI's voice assistant doesn't sound that much like Scarlett Johansson. The movie star has alleged that, though she rebuffed multiple attempts by Sam Altman, the company's CEO, to license her voice for the product that it demoed last week, the one it ended up using was "eerily similar" to her own. Not everyone finds the similarity so eerie--to my ear, it lacks her distinctive smoky rasp--but at the very least, the new AI does appear to imitate the playful lilts and cadences that Johansson used while playing Samantha, the digital assistant in the 2013 film Her. That's depressing--and not only because OpenAI may have run roughshod over Johansson's wishes, but because it has made such an unimaginative choice.