Generative AI
Prompt Smells: An Omen for Undesirable Generative AI Outputs
Ronanki, Krishna, Cabrero-Daniel, Beatriz, Berger, Christian
Recent Generative Artificial Intelligence (GenAI) trends focus on various applications, including creating stories, illustrations, poems, articles, computer code, music compositions, and videos. Extrinsic hallucinations are a critical limitation of such GenAI, which can lead to significant challenges in achieving and maintaining the trustworthiness of GenAI. In this paper, we propose two new concepts that we believe will aid the research community in addressing limitations associated with the application of GenAI models. First, we propose a definition for the "desirability" of GenAI outputs and three factors which are observed to influence it. Second, drawing inspiration from Martin Fowler's code smells, we propose the concept of "prompt smells" and the adverse effects they are observed to have on the desirability of GenAI outputs. We expect our work will contribute to the ongoing conversation about the desirability of GenAI outputs and help advance the field in a meaningful way.
From Generative AI to Generative Internet of Things: Fundamentals, Framework, and Outlooks
Wen, Jinbo, Nie, Jiangtian, Kang, Jiawen, Niyato, Dusit, Du, Hongyang, Zhang, Yang, Guizani, Mohsen
Generative Artificial Intelligence (GAI) possesses the capabilities of generating realistic data and facilitating advanced decision-making. By integrating GAI into modern Internet of Things (IoT), Generative Internet of Things (GIoT) is emerging and holds immense potential to revolutionize various aspects of society, enabling more efficient and intelligent IoT applications, such as smart surveillance and voice assistants. In this article, we present the concept of GIoT and conduct an exploration of its potential prospects. Specifically, we first overview four GAI techniques and investigate promising GIoT applications. Then, we elaborate on the main challenges in enabling GIoT and propose a general GAI-based secure incentive mechanism framework to address them, in which we adopt Generative Diffusion Models (GDMs) for incentive mechanism designs and apply blockchain technologies for secure GIoT management. Moreover, we conduct a case study on modern Internet of Vehicle traffic monitoring, which utilizes GDMs to generate effective contracts for incentivizing users to contribute sensing data with high quality. Finally, we suggest several open directions worth investigating for the future popularity of GIoT.
ChatGPT maker quietly changes rules to allow the US military to incorporate its technology
OpenAI, the maker of ChatGPT, has quietly changed its rules and removed a ban on using the chatbot and its other AI tools for military purposes - and revealed that it is already working with the Department of Defense. Experts have previously voiced fears that AI could escalate conflicts around the world thanks to'slaughterbots' which can kill without any human intervention. The rule change, which occurred after Wednesday last week, removed a sentence which said that the company would not permit usage of models for'activity that has high risk of physical harm, including: weapons development, military and warfare.' The spokesman said: 'Our policy does not allow our tools to be used to harm people, develop weapons, for communications surveillance, or to injure others or destroy property. 'There are, however, national security use cases that align with our mission.
Three technology trends shaping 2024's elections
While tech has played a major role in campaigns and political discourse over the past 15 years or so, and candidates and political parties have long tried to make use of big data to learn about and target voters, the past offers limited insight into where we are now. The ground is shifting incredibly quickly at technology's intersection with business, information, and media. So this week I want to run down three of the most important technology trends in the election space that you should stay on top of. Perhaps unsurprisingly, generative AI takes the top spot on our list. Without a doubt, AI that generates text or images will turbocharge political misinformation.
OpenAI bans bot impersonating US presidential candidate Dean Phillips
OpenAI has removed the account of the developer behind an artificial intelligence-powered bot impersonating the US presidential candidate Dean Phillips, saying it violated company policy. Phillips, who is challenging Joe Biden for the Democratic party candidacy, was impersonated by a ChatGPT-powered bot on the dean.bot The bot was backed by Silicon Valley entrepreneurs Matt Krisiloff and Jed Somers, who have started a Super Pac โ a body that funds and supports political candidates โ named We Deserve Better, supporting Phillips. San Francisco-based OpenAI said it had removed a developer account that violated its policies on political campaigning and impersonation. "We recently removed a developer account that was knowingly violating our API usage policies which disallow political campaigning, or impersonating an individual without consent," said the company.
Benchmarking the Robustness of Image Watermarks
An, Bang, Ding, Mucong, Rabbani, Tahseen, Agrawal, Aakriti, Xu, Yuancheng, Deng, Chenghao, Zhu, Sicheng, Mohamed, Abdirisak, Wen, Yuxin, Goldstein, Tom, Huang, Furong
This paper investigates the weaknesses of image watermarking techniques. We present WAVES (Watermark Analysis Via Enhanced Stress-testing), a novel benchmark for assessing watermark robustness, overcoming the limitations of current evaluation methods.WAVES integrates detection and identification tasks, and establishes a standardized evaluation protocol comprised of a diverse range of stress tests. The attacks in WAVES range from traditional image distortions to advanced and novel variations of diffusive, and adversarial attacks. Our evaluation examines two pivotal dimensions: the degree of image quality degradation and the efficacy of watermark detection after attacks. We develop a series of Performance vs. Quality 2D plots, varying over several prominent image similarity metrics, which are then aggregated in a heuristically novel manner to paint an overall picture of watermark robustness and attack potency. Our comprehensive evaluation reveals previously undetected vulnerabilities of several modern watermarking algorithms. We envision WAVES as a toolkit for the future development of robust watermarking systems. The project is available at https://wavesbench.github.io/
GenAI Against Humanity: Nefarious Applications of Generative Artificial Intelligence and Large Language Models
Charting the Landscape of Nefarious Applications of Generative Artificial Intelligence and Large Language Models Generative Artificial Intelligence (GenAI) and Large Language Models (LLMs) are marvels of technology; celebrated for their prowess in natural language processing and multimodal content generation, they promise a transformative future. But as with all powerful tools, they come with their shadows. Picture living in a world where deepfakes are indistinguishable from reality, where synthetic identities orchestrate malicious campaigns, and where targeted misinformation or scams are crafted with unparalleled precision. Welcome to the darker side of GenAI applications. This article is not just a journey through the meanders of potential misuse of GenAI and LLMs, but also a call to recognize the urgency of the challenges ahead. As we navigate the seas of misinformation campaigns, malicious content generation, and the eerie creation of sophisticated malware, we'll uncover the societal implications that ripple through the GenAI revolution we are witnessing. From AI-powered botnets on social media platforms to the unnerving potential of AI to generate fabricated identities, or alibis made of synthetic realities, the stakes have never been higher. The lines between the virtual and the real worlds are blurring, and the consequences of potential GenAI's nefarious applications impact us all. This article serves both as a synthesis of rigorous research presented on the risks of GenAI and misuse of LLMs and as a thought-provoking vision of the different types of harmful GenAI applications we might encounter in the near future, and some ways we can prepare for them. Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. INTRODUCTION In March 2019, a UK-based energy firm's CEO was duped out of $243,000.
OpenAI suspends developer over ChatGPT bot that impersonated a presidential candidate
OpenAI has suspended the developer behind Dean.Bot, a ChatGPT-powered bot designed to impersonate Democratic presidential candidate Dean Phillips to help bolster his campaign, according to The Washington Post. The chatbot was created by AI startup Delphi for the super PAC We Deserve Better, which supports Phillips. Dean.Bot didn't all-out pretend to be Phillips himself; before engaging with Dean.Bot, website visitors would be shown a disclaimer describing the nature of the chatbot. Still, this type of use goes directly against OpenAI's policies. A spokesperson for the company confirmed the developer's suspension in a statement to the Post. It comes just weeks after OpenAI published a lengthy blog post about the measures it's taking to prevent the misuse of its technology ahead of the 2024 elections, specifically citing "chatbots impersonating candidates" as an example of what's not allowed.
Generative AI-Driven Human Digital Twin in IoT-Healthcare: A Comprehensive Survey
Chen, Jiayuan, Shi, You, Yi, Changyan, Du, Hongyang, Kang, Jiawen, Niyato, Dusit
The Internet of things (IoT) can significantly enhance the quality of human life, specifically in healthcare, attracting extensive attentions to IoT-healthcare services. Meanwhile, the human digital twin (HDT) is proposed as an innovative paradigm that can comprehensively characterize the replication of the individual human body in the digital world and reflect its physical status in real time. Naturally, HDT is envisioned to empower IoT-healthcare beyond the application of healthcare monitoring by acting as a versatile and vivid human digital testbed, simulating the outcomes and guiding the practical treatments. However, successfully establishing HDT requires high-fidelity virtual modeling and strong information interactions but possibly with scarce, biased and noisy data. Fortunately, a recent popular technology called generative artificial intelligence (GAI) may be a promising solution because it can leverage advanced AI algorithms to automatically create, manipulate, and modify valuable while diverse data. This survey particularly focuses on the implementation of GAI-driven HDT in IoT-healthcare. We start by introducing the background of IoT-healthcare and the potential of GAI-driven HDT. Then, we delve into the fundamental techniques and present the overall framework of GAI-driven HDT. After that, we explore the realization of GAI-driven HDT in detail, including GAI-enabled data acquisition, communication, data management, digital modeling, and data analysis. Besides, we discuss typical IoT-healthcare applications that can be revolutionized by GAI-driven HDT, namely personalized health monitoring and diagnosis, personalized prescription, and personalized rehabilitation. Finally, we conclude this survey by highlighting some future research directions.
Scalable High-Resolution Pixel-Space Image Synthesis with Hourglass Diffusion Transformers
Crowson, Katherine, Baumann, Stefan Andreas, Birch, Alex, Abraham, Tanishq Mathew, Kaplan, Daniel Z., Shippole, Enrico
We present the Hourglass Diffusion Transformer (HDiT), an image generative model that exhibits linear scaling with pixel count, supporting training at high-resolution (e.g. $1024 \times 1024$) directly in pixel-space. Building on the Transformer architecture, which is known to scale to billions of parameters, it bridges the gap between the efficiency of convolutional U-Nets and the scalability of Transformers. HDiT trains successfully without typical high-resolution training techniques such as multiscale architectures, latent autoencoders or self-conditioning. We demonstrate that HDiT performs competitively with existing models on ImageNet $256^2$, and sets a new state-of-the-art for diffusion models on FFHQ-$1024^2$.