Goto

Collaborating Authors

 Generative AI


Question Suggestion for Conversational Shopping Assistants Using Product Metadata

arXiv.org Artificial Intelligence

Digital assistants have become ubiquitous in e-commerce applications, following the recent advancements in Information Retrieval (IR), Natural Language Processing (NLP) and Generative Artificial Intelligence (AI). However, customers are often unsure or unaware of how to effectively converse with these assistants to meet their shopping needs. In this work, we emphasize the importance of providing customers a fast, easy to use, and natural way to interact with conversational shopping assistants. We propose a framework that employs Large Language Models (LLMs) to automatically generate contextual, useful, answerable, fluent and diverse questions about products, via in-context learning and supervised fine-tuning. Recommending these questions to customers as helpful suggestions or hints to both start and continue a conversation can result in a smoother and faster shopping experience with reduced conversation overhead and friction. We perform extensive offline evaluations, and discuss in detail about potential customer impact, and the type, length and latency of our generated product questions if incorporated into a real-world shopping assistant.


Creation of Novel Soft Robot Designs using Generative AI

arXiv.org Artificial Intelligence

Soft robotics has emerged as a promising field with the potential to revolutionize industries such as healthcare and manufacturing. However, designing effective soft robots presents challenges, particularly in managing the complex interplay of material properties, structural design, and control strategies. Traditional design methods are often time-consuming and may not yield optimal designs. In this paper, we explore the use of generative AI to create 3D models of soft actuators. We create a dataset of over 70 text-shape pairings of soft pneumatic robot actuator designs, and adapt a latent diffusion model (SDFusion) to learn the data distribution and generate novel designs from it. By employing transfer learning and data augmentation techniques, we significantly improve the performance of the diffusion model. These findings highlight the potential of generative AI in designing complex soft robotic systems, paving the way for future advancements in the field.


The Psychosocial Impacts of Generative AI Harms

arXiv.org Artificial Intelligence

The rapid emergence of generative Language Models (LMs) has led to growing concern about the impacts that their unexamined adoption may have on the social well-being of diverse user groups. Meanwhile, LMs are increasingly being adopted in K-20 schools and one-on-one student settings with minimal investigation of potential harms associated with their deployment. Motivated in part by real-world/everyday use cases (e.g., an AI writing assistant) this paper explores the potential psychosocial harms of stories generated by five leading LMs in response to open-ended prompting. We extend findings of stereotyping harms analyzing a total of 150K 100-word stories related to student classroom interactions. Examining patterns in LM-generated character demographics and representational harms (i.e., erasure, subordination, and stereotyping) we highlight particularly egregious vignettes, illustrating the ways LM-generated outputs may influence the experiences of users with marginalized and minoritized identities, and emphasizing the need for a critical understanding of the psychosocial impacts of generative AI tools when deployed and utilized in diverse social contexts.


Microsoft's OpenAI partnership was born from Google envy

Engadget

It turns out the lay of today's AI landscape can be traced back to -- what do you know -- fear, jealousy and intense capitalist ambition. Emails revealed in the Department of Justice's antitrust case against Google, first reported by Business Insider, show Microsoft executives expressing alarm and envy over Google's AI lead. That spurred an urgency that led to the Windows maker's initial billion-dollar investment in its now-indispensable partner, OpenAI. In a heavily redacted 2019 email thread titled "Thoughts on OpenAI," Microsoft CEO Satya Nadella forwards a lengthy message from CTO Kevin Scott to CFO Amy Hood. "Very good email that explains, why I want us to do this ... and also why we will then ensure our infra folks execute," Nadella wrote.


Sam Altman says helpful agents are poised to become AI's killer function

MIT Technology Review

Its leading applications, like DALL-E, Sora, and ChatGPT (which Altman referred to as "incredibly dumb" compared with what's coming next), have wowed us with their ability to generate convincing text and surreal videos and images. But they mostly remain tools we use for isolated tasks, and they have limited capacity to learn about us from our conversations with them. In the new paradigm, as Altman sees it, the AI will be capable of helping us outside the chat interface and taking real-world tasks off our plates. I asked Altman if we'll need a new piece of hardware to get to this future. Though smartphones are extraordinarily capable, and their designers are already incorporating more AI-driven features, some entrepreneurs are betting that the AI of the future will require a device that's more purpose built. Some of these devices are already beginning to appear in his orbit.


ChatGPT's chatbot rival Claude to be introduced on iPhone

The Guardian

OpenAI's ChatGPT is facing serious competition, as the company's rival Anthropic brings its Claude chatbot to iPhones. Anthropic, led by a group of former OpenAI staff who quit over differences with chief executive Sam Altman, have a product that already beats ChatGPT on some measures of intelligence, and now wants to win over everyday users. "In today's world, smartphones are at the centre of how people interact with technology. To make Claude a true AI assistant, it's crucial that we meet users where they are – and in many cases, that's on their mobile devices," said Scott White at Anthropic. The third version of the Claude chatbot is offered direct to users on its website in three flavours: a speedy and simple model called "haiku", a slower and more powerful model called "sonnet", and, for paying customers only, the full "opus" system.


Microsoft and OpenAI sued yet again by Chicago Tribune and New York Daily News

Engadget

A group of publications that include the Chicago Tribune, New York Daily News and the Orlando Sentinel are suing Microsoft and OpenAI, as reported by The Verge. Their products can regurgitate Times' articles verbatim and can "mimic its expressive style," the publication said, even though they didn't have a prior licensing agreement. In a motion seeking to dismiss key parts of the lawsuit, Microsoft accused the Times of doomsday futurology by claiming that generative AI can pose a threat to independent journalism. ACG's newspapers complain of the same thing, that the companies' chatbots are reproducing their articles word-for-word shortly after they're published without a prominent link back to the sources. They included several examples in their complaint.


Generative manufacturing systems using diffusion models and ChatGPT

arXiv.org Artificial Intelligence

In this study, we introduce Generative Manufacturing Systems (GMS) as a novel approach to effectively manage and coordinate autonomous manufacturing assets, thereby enhancing their responsiveness and flexibility to address a wide array of production objectives and human preferences. Deviating from traditional explicit modeling, GMS employs generative AI, including diffusion models and ChatGPT, for implicit learning from envisioned futures, marking a shift from a model-optimum to a training-sampling decision-making. Through the integration of generative AI, GMS enables complex decision-making through interactive dialogue with humans, allowing manufacturing assets to generate multiple high-quality global decisions that can be iteratively refined based on human feedback. Empirical findings showcase GMS's substantial improvement in system resilience and responsiveness to uncertainties, with decision times reduced from seconds to milliseconds. The study underscores the inherent creativity and diversity in the generated solutions, facilitating human-centric decision-making through seamless and continuous human-machine interactions.


Towards Green AI: Current status and future research

arXiv.org Artificial Intelligence

We are in the midst of an explosive growth of the The rapidly growing computational requirements of AI development and integration of artificial intelligence (AI)- models necessitate increasingly powerful hardware to provide based systems into all aspects of human activities that has the computational infrastructure required for the training and been speculated to be'as transformative as the industrial inference of AI models. Graphics processing units (GPU) revolution' and could incur profound social and economic provide the parallel processing capabilities and are employed changes [1]. The release of'generative AI' applications, in server systems operated in globally distributed data centers notably the text generator ChatGPT, text-to-image generators ('the cloud'). The energy needs of the compute hardware and like Midjourney, and text-to-video models like Sora have required heating, ventilation, and air conditioning (HVAC) in recently brought public attention to the rapidly progressing data centers are ever-increasing. The IEA projects the technological capabilities.


Survey of Bias In Text-to-Image Generation: Definition, Evaluation, and Mitigation

arXiv.org Artificial Intelligence

The recent advancement of large and powerful models with Text-to-Image (T2I) generation abilities -- such as OpenAI's DALLE-3 and Google's Gemini -- enables users to generate high-quality images from textual prompts. However, it has become increasingly evident that even simple prompts could cause T2I models to exhibit conspicuous social bias in generated images. Such bias might lead to both allocational and representational harms in society, further marginalizing minority groups. Noting this problem, a large body of recent works has been dedicated to investigating different dimensions of bias in T2I systems. However, an extensive review of these studies is lacking, hindering a systematic understanding of current progress and research gaps. We present the first extensive survey on bias in T2I generative models. In this survey, we review prior studies on dimensions of bias: Gender, Skintone, and Geo-Culture. Specifically, we discuss how these works define, evaluate, and mitigate different aspects of bias. We found that: (1) while gender and skintone biases are widely studied, geo-cultural bias remains under-explored; (2) most works on gender and skintone bias investigated occupational association, while other aspects are less frequently studied; (3) almost all gender bias works overlook non-binary identities in their studies; (4) evaluation datasets and metrics are scattered, with no unified framework for measuring biases; and (5) current mitigation methods fail to resolve biases comprehensively. Based on current limitations, we point out future research directions that contribute to human-centric definitions, evaluations, and mitigation of biases. We hope to highlight the importance of studying biases in T2I systems, as well as encourage future efforts to holistically understand and tackle biases, building fair and trustworthy T2I technologies for everyone.