Goto

Collaborating Authors

 Generative AI


Predicting the usability of mobile applications using AI tools: the rise of large user interface models, opportunities, and challenges

arXiv.org Artificial Intelligence

In 2022, 255 billion new app downloads were registered, and a whopping 167 billion USD was spent on app stores, a drastic increase from 230 billion app downloads in 2021. Interestingly, artificial intelligence is projected to increase mobile app downloads by 10% in 2024. To continue fueling their revenues in a highly competitive and volatile market, mobile app companies need to dedicate significant efforts to the design of user-friendly interfaces and the usability of their applications. Usability testing of mobile applications is inherently a complex and expensive process [1], yet rewarding in elaborating user requirements, identifying usability issues, and improving the quality of user experience [2]. Mobile usability testing encompasses several intertwined and laborious phases, including planning and designing the evaluation sessions, recruiting the intended users, conducting the testing sessions, and analyzing testing data to extract actionable insights [1].


The Role of AI in Peer Support for Young People: A Study of Preferences for Human- and AI-Generated Responses

arXiv.org Artificial Intelligence

Generative Artificial Intelligence (AI) is integrated into everyday technology, including news, education, and social media. AI has further pervaded private conversations as conversational partners, auto-completion, and response suggestions. As social media becomes young people's main method of peer support exchange, we need to understand when and how AI can facilitate and assist in such exchanges in a beneficial, safe, and socially appropriate way. We asked 622 young people to complete an online survey and evaluate blinded human- and AI-generated responses to help-seeking messages. We found that participants preferred the AI-generated response to situations about relationships, self-expression, and physical health. However, when addressing a sensitive topic, like suicidal thoughts, young people preferred the human response. We also discuss the role of training in online peer support exchange and its implications for supporting young people's well-being. Disclaimer: This paper includes sensitive topics, including suicide ideation. Reader discretion is advised.


A Literature Review and Framework for Human Evaluation of Generative Large Language Models in Healthcare

arXiv.org Artificial Intelligence

As generative artificial intelligence (AI), particularly Large Language Models (LLMs), continues to permeate healthcare, it remains crucial to supplement traditional automated evaluations with human expert evaluation. Understanding and evaluating the generated texts is vital for ensuring safety, reliability, and effectiveness. However, the cumbersome, time-consuming, and non-standardized nature of human evaluation presents significant obstacles to the widespread adoption of LLMs in practice. This study reviews existing literature on human evaluation methodologies for LLMs within healthcare. We highlight a notable need for a standardized and consistent human evaluation approach. Our extensive literature search, adhering to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, spans publications from January 2018 to February 2024. This review provides a comprehensive overview of the human evaluation approaches used in diverse healthcare applications.This analysis examines the human evaluation of LLMs across various medical specialties, addressing factors such as evaluation dimensions, sample types, and sizes, the selection and recruitment of evaluators, frameworks and metrics, the evaluation process, and statistical analysis of the results. Drawing from diverse evaluation strategies highlighted in these studies, we propose a comprehensive and practical framework for human evaluation of generative LLMs, named QUEST: Quality of Information, Understanding and Reasoning, Expression Style and Persona, Safety and Harm, and Trust and Confidence. This framework aims to improve the reliability, generalizability, and applicability of human evaluation of generative LLMs in different healthcare applications by defining clear evaluation dimensions and offering detailed guidelines.


An Attention-Based Deep Generative Model for Anomaly Detection in Industrial Control Systems

arXiv.org Artificial Intelligence

Anomaly detection is critical for the secure and reliable operation of industrial control systems. As our reliance on such complex cyber-physical systems grows, it becomes paramount to have automated methods for detecting anomalies, preventing attacks, and responding intelligently. {This paper presents a novel deep generative model to meet this need. The proposed model follows a variational autoencoder architecture with a convolutional encoder and decoder to extract features from both spatial and temporal dimensions. Additionally, we incorporate an attention mechanism that directs focus towards specific regions, enhancing the representation of relevant features and improving anomaly detection accuracy. We also employ a dynamic threshold approach leveraging the reconstruction probability and make our source code publicly available to promote reproducibility and facilitate further research. Comprehensive experimental analysis is conducted on data from all six stages of the Secure Water Treatment (SWaT) testbed, and the experimental results demonstrate the superior performance of our approach compared to several state-of-the-art baseline techniques.


Fake Artificial Intelligence Generated Contents (FAIGC): A Survey of Theories, Detection Methods, and Opportunities

arXiv.org Artificial Intelligence

In recent years, generative artificial intelligence models, represented by Large Language Models (LLMs) and Diffusion Models (DMs), have revolutionized content production methods. These artificial intelligence-generated content (AIGC) have become deeply embedded in various aspects of daily life and work. However, these technologies have also led to the emergence of Fake Artificial Intelligence Generated Content (FAIGC), posing new challenges in distinguishing genuine information. It is crucial to recognize that AIGC technology is akin to a double-edged sword; its potent generative capabilities, while beneficial, also pose risks for the creation and dissemination of FAIGC. In this survey, We propose a new taxonomy that provides a more comprehensive breakdown of the space of FAIGC methods today. Next, we explore the modalities and generative technologies of FAIGC. We introduce FAIGC detection methods and summarize the related benchmark from various perspectives. Finally, we discuss outstanding challenges and promising areas for future research.


New contexts, old heuristics: How young people in India and the US trust online content in the age of generative AI

arXiv.org Artificial Intelligence

We conducted an in-person ethnography in India and the US to investigate how young people (18-24) trusted online content, with a focus on generative AI (GenAI). We had four key findings about how young people use GenAI and determine what to trust online. First, when online, we found participants fluidly shifted between mindsets and emotional states, which we term "information modes." Second, these information modes shaped how and why participants trust GenAI and how they applied literacy skills. In the modes where they spent most of their time, they eschewed literacy skills. Third, with the advent of GenAI, participants imported existing trust heuristics from familiar online contexts into their interactions with GenAI. Fourth, although study participants had reservations about GenAI, they saw it as a requisite tool to adopt to keep up with the times. Participants valued efficiency above all else, and used GenAI to further their goals quickly at the expense of accuracy. Our findings suggest that young people spend the majority of their time online not concerned with truth because they are seeking only to pass the time. As a result, literacy interventions should be designed to intervene at the right time, to match users' distinct information modes, and to work with their existing fact-checking practices.


The Morning After: Microsoft's OpenAI partnership was born from Google AI envy

Engadget

Emails from the Department of Justice's antitrust case against Google revealed how Microsoft executives were alarmed by and even envious of Google's AI lead. In an email thread, CTO Kevin Scott wrote he was "very, very worried" about Google's rapidly growing AI capabilities. He said he initially dismissed the company's "game-playing stunts," likely referring to Google's AlphaGo models. The emails reference Gmail's autocomplete features, which execs called "scary good." Microsoft struggled to copy Google's BERT-large, an AI model that deciphers the meaning and context of words in a sentence.


The Unsexy Future of Generative AI Is Enterprise Apps

WIRED

Keith Peiris says he started to see the generative AI writing on the wall six months ago. Peiris is the cofounder and chief executive of Tome, a San Francisco startup that makes presentation software juiced with generative AI. The company launched its product in early 2022 with a healthy cushion of 32 million in venture capital funding, and successfully surfed the ChatGPT hype wave after that, raising even more funding in early 2023. Venture capitalist and LinkedIn cofounder Reid Hoffman, former Google CEO and chairman Eric Schmidt, and Stability.ai's Tome had one problem, though: It wasn't generating meaningful revenue.


Apple tapping AI to boost iPhone demand ahead of expected sales decline

The Japan Times

Apple's plan to add generative AI to its iPhones and revive sagging sales in the crucial Chinese market will be in focus on Thursday, when the tech giant is expected to report its biggest quarterly revenue decline in more than a year. Long considered a must-own stock on Wall Street, Apple shares have underperformed other big tech companies in recent months -- falling more than 10% this year as fears mount about its slow roll-out of artificial intelligence services and as a resurgent Huawei takes market share in China. Analysts on average see iPhone sales, which account for about half of Apple's revenue, falling 10.4% in the first three months of 2024, according to LSEG. That drop would be the steepest in more than three years.


Natural Language to Verilog: Design of a Recurrent Spiking Neural Network using Large Language Models and ChatGPT

arXiv.org Artificial Intelligence

This paper investigates the use of Large Language Models (LLMs) for automating the generation of hardware description code, aiming to explore their potential in supporting and enhancing the development of efficient neuromorphic computing architectures. Building on our prior work, we employ OpenAI's ChatGPT4 and natural language prompts to synthesize a RTL Verilog module of a programmable recurrent spiking neural network, while also generating test benches to assess the system's correctness. The resultant design was validated in three case studies, the exclusive OR,the IRIS flower classification and the MNIST hand-written digit classification, achieving accuracies of up to 96.6%. To verify its synthesizability and implementability, the design was prototyped on a field-programmable gate array and implemented on SkyWater 130 nm technology by using an open-source electronic design automation flow. Additionally, we have submitted it to Tiny Tapeout 6 chip fabrication program to further evaluate the system on-chip performance in the future.