Goto

Collaborating Authors

 Media


Exploring the Design of Generative AI in Supporting Music-based Reminiscence for Older Adults

arXiv.org Artificial Intelligence

Music-based reminiscence has the potential to positively impact the psychological well-being of older adults. However, the aging process and physiological changes, such as memory decline and limited verbal communication, may impede the ability of older adults to recall their memories and life experiences. Given the advanced capabilities of generative artificial intelligence (AI) systems, such as generated conversations and images, and their potential to facilitate the reminiscing process, this study aims to explore the design of generative AI to support music-based reminiscence in older adults. This study follows a user-centered design approach incorporating various stages, including detailed interviews with two social workers and two design workshops (involving ten older adults). Our work contributes to an in-depth understanding of older adults' attitudes toward utilizing generative AI for supporting music-based reminiscence and identifies concrete design considerations for the future design of generative AI to enhance the reminiscence experience of older adults.


AI-generated porn, including celebrity fake nudes, persist on Etsy as deepfake laws 'lag behind'

FOX News

Heritage Foundation tech policy director Kara Frederick joins'America's Newsroom' to discuss pornographic AI photos of Taylor Swift sparking conversations about deepfake regulation. Etsy, the online retailer known for providing a platform to sell hand-made and vintage products, continues to host sellers of "deepfake" pornographic images of celebrities and random women despite the company's efforts to clean up the site. The proliferation of sexually explicit images generated by artificial intelligence (AI) -- including depictions of celebrities -- on an otherwise innocuous marketplace comes as a shock to many experts. The problem has persisted on the platform for months. "That sounds like a total innocuous platform for people to do this. Usually we find a lot of explicit content on Twitter, or some other particular portals for that kind of materials," Siwei Lyu, a computer scientist and expert on machine learning and the detection of deepfakes, told Fox News Digital.


A comprehensive cross-language framework for harmful content detection with the aid of sentiment analysis

arXiv.org Artificial Intelligence

In today's digital world, social media plays a significant role in facilitating communication and content sharing. However, the exponential rise in user-generated content has led to challenges in maintaining a respectful online environment. In some cases, users have taken advantage of anonymity in order to use harmful language, which can negatively affect the user experience and pose serious social problems. Recognizing the limitations of manual moderation, automatic detection systems have been developed to tackle this problem. Nevertheless, several obstacles persist, including the absence of a universal definition for harmful language, inadequate datasets across languages, the need for detailed annotation guideline, and most importantly, a comprehensive framework. This study aims to address these challenges by introducing, for the first time, a detailed framework adaptable to any language. This framework encompasses various aspects of harmful language detection. A key component of the framework is the development of a general and detailed annotation guideline. Additionally, the integration of sentiment analysis represents a novel approach to enhancing harmful language detection. Also, a definition of harmful language based on the review of different related concepts is presented. To demonstrate the effectiveness of the proposed framework, its implementation in a challenging low-resource language is conducted. We collected a Persian dataset and applied the annotation guideline for harmful detection and sentiment analysis. Next, we present baseline experiments utilizing machine and deep learning methods to set benchmarks. Results prove the framework's high performance, achieving an accuracy of 99.4% in offensive language detection and 66.2% in sentiment analysis.


SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Code

arXiv.org Artificial Intelligence

This paper introduces SceneCraft, a Large Language Model (LLM) Agent converting text descriptions into Blender-executable Python scripts which render complex scenes with up to a hundred 3D assets. This process requires complex spatial planning and arrangement. We tackle these challenges through a combination of advanced abstraction, strategic planning, and library learning. SceneCraft first models a scene graph as a blueprint, detailing the spatial relationships among assets in the scene. SceneCraft then writes Python scripts based on this graph, translating relationships into numerical constraints for asset layout. Next, SceneCraft leverages the perceptual strengths of vision-language foundation models like GPT-V to analyze rendered images and iteratively refine the scene. On top of this process, SceneCraft features a library learning mechanism that compiles common script functions into a reusable library, facilitating continuous self-improvement without expensive LLM parameter tuning. Our evaluation demonstrates that SceneCraft surpasses existing LLM-based agents in rendering complex scenes, as shown by its adherence to constraints and favorable human assessments. We also showcase the broader application potential of SceneCraft by reconstructing detailed 3D scenes from the Sintel movie and guiding a video generative model with generated scenes as intermediary control signal.


A Survey of AI-generated Text Forensic Systems: Detection, Attribution, and Characterization

arXiv.org Artificial Intelligence

We have witnessed lately a rapid proliferation of advanced Large Language Models (LLMs) capable of generating high-quality text. While these LLMs have revolutionized text generation across various domains, they also pose significant risks to the information ecosystem, such as the potential for generating convincing propaganda, misinformation, and disinformation at scale. This paper offers a review of AI-generated text forensic systems, an emerging field addressing the challenges of LLM misuses. We present an overview of the existing efforts in AI-generated text forensics by introducing a detailed taxonomy, focusing on three primary pillars: detection, attribution, and characterization. These pillars enable a practical understanding of AI-generated text, from identifying AI-generated content (detection), determining the specific AI model involved (attribution), and grouping the underlying intents of the text (characterization). Furthermore, we explore available resources for AI-generated text forensics research and discuss the evolving challenges and future directions of forensic systems in an AI era.


REWIND Dataset: Privacy-preserving Speaking Status Segmentation from Multimodal Body Movement Signals in the Wild

arXiv.org Artificial Intelligence

Recognizing speaking in humans is a central task towards understanding social interactions. Ideally, speaking would be detected from individual voice recordings, as done previously for meeting scenarios. However, individual voice recordings are hard to obtain in the wild, especially in crowded mingling scenarios due to cost, logistics, and privacy concerns. As an alternative, machine learning models trained on video and wearable sensor data make it possible to recognize speech by detecting its related gestures in an unobtrusive, privacy-preserving way. These models themselves should ideally be trained using labels obtained from the speech signal. However, existing mingling datasets do not contain high quality audio recordings. Instead, speaking status annotations have often been inferred by human annotators from video, without validation of this approach against audio-based ground truth. In this paper we revisit no-audio speaking status estimation by presenting the first publicly available multimodal dataset with high-quality individual speech recordings of 33 subjects in a professional networking event. We present three baselines for no-audio speaking status segmentation: a) from video, b) from body acceleration (chest-worn accelerometer), c) from body pose tracks. In all cases we predict a 20Hz binary speaking status signal extracted from the audio, a time resolution not available in previous datasets. In addition to providing the signals and ground truth necessary to evaluate a wide range of speaking status detection methods, the availability of audio in REWIND makes it suitable for cross-modality studies not feasible with previous mingling datasets. Finally, our flexible data consent setup creates new challenges for multimodal systems under missing modalities.


Adam Sandler Is Dropping Quite the Bomb on Netflix Viewers Right Now. I Kind of Enjoyed It.

Slate

Many a cinephile has asked themselves the question: What if Andrei Tarkovsky's Solaris, the avant-garde 1972 sci-fi classic about a widowed space explorer forced to grapple with his grief while on a mission to a mysterious planet, starred Adam Sandler and Carey Mulligan as a fracturing married couple, alongside Paul Dano as the voice of a giant benevolent space spider? And what if Isabella Rossellini were the leader of Czechoslovakia's space program, which somehow, in this universe's alternate version of political and technological history, was the best-equipped in the world to send a manned mission to the outer reaches of Jupiter? The result of that mashup might be something like Spaceman, an oddball psychological drama from the Swedish director Johan Renck, best known for a long rรฉsumรฉ of music videos and lately for helming all five episodes of the acclaimed HBO miniseries Chernobyl. The script, adapted by Colby Day from the 2017 novel Spaceman of Bohemia by Jaroslav Kalfar, leaves many questions unanswered. If the mission of Sandler's character--the depressive, remote, and career-obsessed Jakub--is so significant to humanity's future, it isn't clear why he would have been sent into space all alone.


How Max Tani Became the Go-To Guy for Horrible News About Media Layoffs

Slate

Maxwell Tani is known for his work on an obituary beat of sorts. A media reporter at Semafor, he always seems to be the first person to break news whenever something terrible happens for journalists at one outlet or another. He's been busy: According to one tabulation, more than 500 journalists were laid off just in January. A scroll through Tani's account on X surfaces a glut of executive memos, couched in corporate-speak, informing staff that they'll soon be laid off--at Business Insider, Engadget, the Messenger, Vice, and the Wall Street Journal. Sometimes he shares the news of an impending layoff before these memos even go out--and before employees have been informed. Slate spoke with Tani about what it's like to document the worst moments on the media beat, and how he feels about his place in the news-about-the-news ecosystem. We also tried to diagnose the ills of the industry--and find bright spots ahead.


Adobe's latest AI experiment generates music from text

Engadget

This week, Adobe revealed an experimental audio AI tool to join its image-based ones in Photoshop. Described by the company as "an early-stage generative AI music generation and editing tool," Adobe's Project Music GenAI Control can create music (and other audio) from text prompts, which it can then fine-tune in the same interface. Adobe frames the Firefly-based technology as a creative ally that -- unlike generative audio experiments like Google's MusicLM -- goes a step further and skips the hassle of moving the output to external apps like Pro Tools, Logic Pro or GarageBand for editing. "Instead of manually cutting existing music to make intros, outros, and background audio, Project Music GenAI Control could help users to create exactly the pieces they need--solving workflow pain points end-to-end," Adobe wrote in an announcement blog post. The company suggests starting with text inputs like "powerful rock," "happy dance" or "sad jazz" as a foundation.


Sci-fi series becomes IMDB's highest-rated after 'disappointing' first season FLOPPED in 2022 - and it even beat Netflix's Stranger Things and Black Mirror

Daily Mail - Science & tech

A sci-fi series has taken the number one spot on IMDB following the release of its second season - despite the show's'disappointing' debut in 2022. The first season of the video game adaptation was deemed a'one-hit' wonder' by viewers who felt the story was written by a'high schooler' and the graphics were'low budget CGI.' But Halo season two, released this month, now sits at number one in IDMB's list of top sci-fi TV series. The Paramount series has 7.2 stars and more than 81,000 votes - overtaking popular shows like Netflix's Stranger Things and Black Mirror. Halo also has an 89 percent on Rotten Tomatoes - a jump from season one's 61 percent rating.