Generative AI
Zero-Shot Visual Deepfake Detection: Can AI Predict and Prevent Fake Content Before It's Created?
Sar, Ayan, Roy, Sampurna, Choudhury, Tanupriya, Abraham, Ajith
Generative adversarial networks (GANs) and diffusion models have dramatically advanced deepfake technology, and its threats to digital security, media integrity, and public trust have increased rapidly. This research explored zero-shot deepfake detection, an emerging method even when the models have never seen a particular deepfake variation. In this work, we studied self-supervised learning, transformer-based zero-shot classifier, generative model fingerprinting, and meta-learning techniques that better adapt to the ever-evolving deepfake threat. In addition, we suggested AI-driven prevention strategies that mitigated the underlying generation pipeline of the deepfakes before they occurred. They consisted of adversarial perturbations for creating deepfake generators, digital watermarking for content authenticity verification, real-time AI monitoring for content creation pipelines, and blockchain-based content verification frameworks. Despite these advancements, zero-shot detection and prevention faced critical challenges such as adversarial attacks, scalability constraints, ethical dilemmas, and the absence of standardized evaluation benchmarks. These limitations were addressed by discussing future research directions on explainable AI for deepfake detection, multimodal fusion based on image, audio, and text analysis, quantum AI for enhanced security, and federated learning for privacy-preserving deepfake detection. This further highlighted the need for an integrated defense framework for digital authenticity that utilized zero-shot learning in combination with preventive deepfake mechanisms. Finally, we highlighted the important role of interdisciplinary collaboration between AI researchers, cybersecurity experts, and policymakers to create resilient defenses against the rising tide of deepfake attacks.
Perceptions of AI Across Sectors: A Comparative Review of Public Attitudes
Bialy, Filip, Elliot, Mark, Meckin, Robert
Even though current generation of AI is underpinned by a common technology - namely machine learning, especially in the form of deep learning - in the public eye it has not emerged as a single solution. Rather, it has taken shape through multiple and overlapping applications - ranging from predictive diagnostics in healthcare and algorithmic hiring systems in HR to autonomous weapons and generative language models. As AI becomes increasingly embedded in sector - specific infrastructures, the question of how publics perceive its us e is gaining urgency. Existing literature on public perception of AI suggests that attitudes are highly sensitive to the application domain . People tend to be more supportive of AI in domains where it is perceived to augment human capacity (e.g., in medical diagnostics) and more sceptical when AI is seen as replacing judg e ment or threatening civil liberties or rights (e.g., in security or surveillance). These perceptions are shaped not only by technical features of the AI system but also by institutional trust, cultural attitude s toward risk, and the moral economy of the domain in question. Despite this, few reviews have systematically compared public perceptions across sectors and explored the cross - domain patterns and differences in attitudes.
An N-Plus-1 GPT Agency for Critical Solution of Mechanical Engineering Analysis Problems
Patera, Anthony, Abeyaratne, Rohan
Generative AI, and specifically GPT, can produce a remarkable solution to a mechanical engineering analysis problem - but also, on occasion, a flawed solution. For example, an elementary mechanics problem is solved flawlessly in one GPT instance and incorrectly in a subsequent GPT instance, with a success probability of only 85%. This unreliability renders "out-of-the-box" GPT unsuitable for deployment in education or engineering practice. We introduce an "N-Plus-1" GPT Agency for Initial (Low-Cost) Analysis of mechanical engineering Problem Statements. Agency first launches N instantiations of Agent Solve to yield N independent Proposed Problem Solution Realizations; Agency then invokes Agent Compare to summarize and compare the N Proposed Problem Solution Realizations and to provide a Recommended Problem Solution. We argue from Condorcet's Jury Theorem that, for a Problem Statement characterized by per-Solve success probability greater than 1/2 (and N sufficiently large), the Predominant (Agent Compare) Proposed Problem Solution will, with high probability, correspond to a Correct Proposed Problem Solution. Furthermore, Agent Compare can also incorporate aspects of Secondary (Agent Compare) Proposed Problem Solutions, in particular when the latter represent alternative Problem Statement interpretations - different Mathematical Models - or alternative Mathematical Solution Procedures. Comparisons to Grok Heavy, a commercial multi-agent model, show similarities in design and performance, but also important differences in emphasis: our Agency focuses on transparency and pedagogical value.
OpenAI Teams Up With Oracle and SoftBank to Build 5 New Stargate Data Centers
The new sites will boost Stargate's planned capacity to nearly 7 gigawatts--about equal to the output of seven large nuclear reactors. An aerial view shows construction underway on a Project Stargate AI infrastructure site in Abilene, Texas on April 23, 2025. OpenAI is planning to build five new data centers in the United States as part of the Stargate initiative, the company announced on Tuesday. The sites, which are being developed in partnership with Oracle and SoftBank, bring Stargate's current planned capacity to nearly 7 gigawatts--roughly the same amount of power as seven large-scale nuclear reactors . "AI is different from the internet in a lot of ways, but one of them is just how much infrastructure it takes," OpenAI CEO Sam Altman said during a press briefing in Abilene, Texas on Tuesday.
The Download: AI's retracted papers problem
The Download: AI's retracted papers problem Some AI chatbots rely on flawed research from retracted scientific papers to answer questions, according to recent studies. In one such study, researchers asked OpenAI's ChatGPT questions based on information from 21 retracted papers on medical imaging. The chatbot's answers referenced retracted papers in five cases but advised caution in only three. The findings raise serious questions about how reliable AI tools are at evaluating scientific research, or answering people's health queries. They could also complicate efforts to invest in AI tools for scientists. And it's not an easy problem to fix.
A Generative AI System for Biomedical Data Discovery with Grammar-Based Visualizations
Lange, Devin, Gao, Shanghua, Sui, Pengwei, Money, Austen, Misner, Priya, Zitnik, Marinka, Gehlenborg, Nils
We explore the potential for combining generative AI with grammar-based visualizations for biomedical data discovery. In our prototype, we use a multi-agent system to generate visualization specifications and apply filters. These visualizations are linked together, resulting in an interactive dashboard that is progressively constructed. Our system leverages the strengths of natural language while maintaining the utility of traditional user interfaces. Furthermore, we utilize generated interactive widgets enabling user adjustment. Finally, we demonstrate the potential utility of this system for biomedical data discovery with a case study.
EPIC: Generative AI Platform for Accelerating HPC Operational Data Analytics
Karimi, Ahmad Maroof, Shin, Woong, Hines, Jesse, Ghosal, Tirthankar, Sattar, Naw Safrin, Wang, Feiyi
We present EPIC, an AI-driven platform designed to augment operational data analytics. EPIC employs a hierarchical multi-agent architecture where a top-level large language model provides query processing, reasoning and synthesis capabilities. These capabilities orchestrate three specialized low-level agents for information retrieval, descriptive analytics, and predictive analytics. This architecture enables EPIC to perform HPC operational analytics on multi-modal data, including text, images, and tabular formats, dynamically and iteratively. EPIC addresses the limitations of existing HPC operational analytics approaches, which rely on static methods that struggle to adapt to evolving analytics tasks and stakeholder demands. Through extensive evaluations on the Frontier HPC system, we demonstrate that EPIC effectively handles complex queries. Using descriptive analytics as a use case, fine-tuned smaller models outperform large state-of-the-art foundation models, achieving up to 26% higher accuracy. Additionally, we achieved 19x savings in LLM operational costs compared to proprietary solutions by employing a hybrid approach that combines large foundational models with fine-tuned local open-weight models.
Side Effects of Erasing Concepts from Diffusion Models
Saha, Shaswati, Saha, Sourajit, Gaur, Manas, Gokhale, Tejas
Concerns about text-to-image (T2I) generative models infringing on privacy, copyright, and safety have led to the development of concept erasure techniques (CETs). The goal of an effective CET is to prohibit the generation of undesired "target" concepts specified by the user, while preserving the ability to synthesize high-quality images of other concepts. In this work, we demonstrate that concept erasure has side effects and CETs can be easily circumvented. For a comprehensive measurement of the robustness of CETs, we present the Side Effect Evaluation (SEE) benchmark that consists of hierarchical and compositional prompts describing objects and their attributes. The dataset and an automated evaluation pipeline quantify side effects of CETs across three aspects: impact on neighboring concepts, evasion of targets, and attribute leakage. Our experiments reveal that CETs can be circumvented by using superclass-subclass hierarchy, semantically similar prompts, and compositional variants of the target. We show that CETs suffer from attribute leakage and a counterintuitive phenomenon of attention concentration or dispersal. We release our benchmark and evaluation tools to aid future work on robust concept erasure.
Jailbreak-Tuning: Models Efficiently Learn Jailbreak Susceptibility
Murphy, Brendan, Bowen, Dillon, Mohammadzadeh, Shahrad, Tseng, Tom, Broomfield, Julius, Gleave, Adam, Pelrine, Kellin
AI systems are rapidly advancing in capability, and frontier model developers broadly acknowledge the need for safeguards against serious misuse. However, this paper demonstrates that fine-tuning, whether via open weights or closed fine-tuning APIs, can produce helpful-only models with safeguards destroyed. In contrast to prior work which is blocked by modern moderation systems or achieved only partial removal of safeguards or degraded output quality, our jailbreak-tuning method teaches models to generate detailed, high-quality responses to arbitrary harmful requests. For example, OpenAI, Google, and Anthropic models will fully comply with requests for CBRN assistance, executing cyberattacks, and other criminal activity. We further show that backdoors can increase not only the stealth but also the severity of attacks. Stronger jailbreak prompts become even more effective in fine-tuning attacks, linking attacks and potentially defenses in the input and weight spaces. Not only are current models vulnerable, more recent ones also appear to be becoming even more vulnerable to these attacks, underscoring the urgent need for tamper-resistant safeguards. Until such safeguards are discovered, companies and policymakers should view the release of any fine-tunable model as simultaneously releasing its evil twin: equally capable as the original model, and usable for any malicious purpose within its capabilities.
AutiHero: Leveraging Generative AI in Social Narratives to Engage Parents in Story-Driven Behavioral Guidance for Autistic Children
Lee, Jungeun, Lee, Kyungah, Hwang, Inseok, Park, SoHyun, Kim, Young-Ho
Social narratives are known to help autistic children understand and navigate social situations through stories. To ensure effectiveness, however, the materials need to be customized to reflect each child's unique behavioral context, requiring considerable time and effort for parents to practice at home. We present AutiHero, a generative AI-based social narrative system for behavioral guidance, which supports parents to create personalized stories for their autistic children and read them together. AutiHero generates text and visual illustrations that reflect their children's interests, target behaviors, and everyday contexts. In a two-week deployment study with 16 autistic child-parent dyads, parents created 218 stories and read an average of 4.25 stories per day, demonstrating a high level of engagement. AutiHero also provided an effective, low-demanding means to guide children's social behaviors, encouraging positive change. We discuss the implications of generative AI-infused tools to empower parents in guiding their children's behaviors, fostering their social learning.