Media
RLPF: Reinforcement Learning from Prediction Feedback for User Summarization with LLMs
Wu, Jiaxing, Ning, Lin, Liu, Luyang, Lee, Harrison, Wu, Neo, Wang, Chao, Prakash, Sushant, O'Banion, Shawn, Green, Bradley, Xie, Jun
LLM-powered personalization agent systems employ Large Language Models (LLMs) to predict users' behavior from their past activities. However, their effectiveness often hinges on the ability to effectively leverage extensive, long user historical data due to its inherent noise and length of such data. Existing pretrained LLMs may generate summaries that are concise but lack the necessary context for downstream tasks, hindering their utility in personalization systems. To address these challenges, we introduce Reinforcement Learning from Prediction Feedback (RLPF). RLPF fine-tunes LLMs to generate concise, human-readable user summaries that are optimized for downstream task performance. By maximizing the usefulness of the generated summaries, RLPF effectively distills extensive user history data while preserving essential information for downstream tasks. Our empirical evaluation demonstrates significant improvements in both extrinsic downstream task utility and intrinsic summary quality, surpassing baseline methods by up to 22% on downstream task performance and achieving an up to 84.59% win rate on Factuality, Abstractiveness, and Readability. RLPF also achieves a remarkable 74% reduction in context length while improving performance on 16 out of 19 unseen tasks and/or datasets, showcasing its generalizability. This approach offers a promising solution for enhancing LLM personalization by effectively transforming long, noisy user histories into informative and human-readable representations.
A+AI: Threats to Society, Remedies, and Governance
This document focuses on the threats, especially near-term threats, that Artificial Intelligence (AI) brings to society. Most of the threats discussed here can result from any algorithmic process, not just AI; in addition, defining AI is notoriously difficult. For both reasons, it is important to think of "A+AI": Algorithms and Artificial Intelligence. In addition to the threats, this paper discusses countermeasures to them, and it includes a table showing which countermeasures are likely to mitigate which threats. Thoughtful governance could manage the risks without seriously impeding progress; in fact, chances are it would accelerate progress by reducing the social chaos that would otherwise be likely.
Man with AI song catalog 'defrauds' streaming services of 10 million
Musicians have long criticized streaming services for their abysmal revenue sharing programs. In 2021, for example, as much as 97 percent of Spotify's over 6 million listed artists earned less than 1,000. Last year, the company announced a new system offering fractions of a cent per track, all of which is now based on even more stringent rules. But there was apparently a way to earn some real dividends from those songs--provided you have access to thousands of bots, hundreds of thousands of AI-generated songs, and are willing to risk receiving a federal grand jury indictment for wire fraud and money laundering. That's what a man named Michael Smith in North Carolina is currently facing, according to a DOJ announcement on September 4. Unsealed filings from US prosecutors accuse Smith of scamming digital streaming platforms including Spotify, Apple Music, Amazon Music, and YouTube Music of over 10 million in royalty payouts between 2017 and 2024.
Alleged fraudster got 10 million in royalties using robots to stream AI-made music
A North Carolina man is facing fraud charges after allegedly uploading hundreds of thousands of AI-generated songs to streaming services and using bots to play them billions of times. Michael Smith is said to have received over 10 million in royalties since 2017 via the scheme. Smith, 52, was arrested on Wednesday. An indictment [PDF] that was unsealed the same day accuses him of using the bots to steal royalty payments from platforms including Spotify, Apple Music and Amazon Music. Smith has been charged with wire fraud conspiracy, wire fraud and money laundering conspiracy.
Best podcasts of the week: New Order's rise from the ashes of Joy Division
Origins With Cush Jumbo Widely available, episodes weekly Cush Jumbo is always good fun when doing press interviews for her work (The Good Wife, Criminal Record, Hamlet) – and she's just as great now the tables are turned in her first podcast. She speaks to stars about their origin stories, including Kate Nash, Harlan Coben, David Schwimmer and, in episode one, Anna Wintour, who says she hates people who waffle and recalls getting fired from Harper's Bazaar because she couldn't pin a dress. Rebel Spirit Widely available, episodes weekly Comedian Akilah Hughes gives her serious mission a light touch as she returns to her Kentucky home town to try to change her high school's racist mascot from a Confederate general to a biscuit. Can she drag the school into the modern age – and what will the change mean to her and other pupils? Sara & Cariad's Weirdos Book Club Widely available, episodes weekly Sara Pascoe and Cariad Lloyd go beyond the usual selections with season two of their book club for people who don't want to discuss reading over cheese and wine.
Disclosure of AI-Generated News Increases Engagement but Does Not Reduce Aversion, Despite Positive Quality Ratings
Gilardi, Fabrizio, Di Lorenzo, Sabrina, Ezzaini, Juri, Santa, Beryl, Streiff, Benjamin, Zurfluh, Eric, Hoes, Emma
The advancement of artificial intelligence (AI) has led to its application in many areas, including journalism. One key issue is the public's perception of AI-generated content. This preregistered study investigates (i) the perceived quality of AI-assisted and AI-generated versus human-generated news articles, (ii) whether disclosure of AI's involvement in generating these news articles influences engagement with them, and (iii) whether such awareness affects the willingness to read AI-generated articles in the future. We employed a between-subjects survey experiment with 599 participants from the German-speaking part of Switzerland, who evaluated the credibility, readability, and expertise of news articles. These articles were either written by journalists (control group), rewritten by AI (AI-assisted group), or entirely generated by AI (AI-generated group). Our results indicate that all news articles, regardless of whether they were written by journalists or AI, were perceived to be of equal quality. When participants in the treatment groups were subsequently made aware of AI's involvement in generating the articles, they expressed a higher willingness to engage with (i.e., continue reading) the articles than participants in the control group. However, they were not more willing to read AI-generated news in the future. These results suggest that aversion to AI usage in news media is not primarily rooted in a perceived lack of quality, and that by disclosing using AI, journalists could attract more immediate engagement with their content, at least in the short term.
The Role of Generative Systems in Historical Photography Management: A Case Study on Catalan Archives
Śanchez, Èric, Molina, Adrià, Terrades, Oriol Ramos
The use of image analysis in automated photography management is an increasing trend in heritage institutions. Such tools alleviate the human cost associated with the manual and expensive annotation of new data sources while facilitating fast access to the citizenship through online indexes and search engines. However, available tagging and description tools are usually designed around modern photographs in English, neglecting historical corpora in minoritized languages, each of which exhibits intrinsic particularities. The primary objective of this research is to study the quantitative contribution of generative systems in the description of historical sources. This is done by contextualizing the task of captioning historical photographs from the Catalan archives as a case study. Our findings provide practitioners with tools and directions on transfer learning for captioning models based on visual adaptation and linguistic proximity.
UserSumBench: A Benchmark Framework for Evaluating User Summarization Approaches
Wang, Chao, Wu, Neo, Ning, Lin, Wu, Jiaxing, Liu, Luyang, Xie, Jun, O'Banion, Shawn, Green, Bradley
Large language models (LLMs) have shown remarkable capabilities in generating user summaries from a long list of raw user activity data. These summaries capture essential user information such as preferences and interests, and therefore are invaluable for LLM-based personalization applications, such as explainable recommender systems. However, the development of new summarization techniques is hindered by the lack of ground-truth labels, the inherent subjectivity of user summaries, and human evaluation which is often costly and time-consuming. To address these challenges, we introduce \UserSumBench, a benchmark framework designed to facilitate iterative development of LLM-based summarization approaches. This framework offers two key components: (1) A reference-free summary quality metric. We show that this metric is effective and aligned with human preferences across three diverse datasets (MovieLens, Yelp and Amazon Review). (2) A novel robust summarization method that leverages time-hierarchical summarizer and self-critique verifier to produce high-quality summaries while eliminating hallucination. This method serves as a strong baseline for further innovation in summarization techniques.
MetaBGM: Dynamic Soundtrack Transformation For Continuous Multi-Scene Experiences With Ambient Awareness And Personalization
Liu, Haoxuan, Wang, Zihao, Hong, Haorong, Feng, Youwei, Yu, Jiaxin, Diao, Han, Xu, Yunfei, Zhang, Kejun
This paper introduces MetaBGM, a groundbreaking framework for generating background music that adapts to dynamic scenes and real-time user interactions. We define multi-scene as variations in environmental contexts, such as transitions in game settings or movie scenes. To tackle the challenge of converting backend data into music description texts for audio generation models, MetaBGM employs a novel two-stage generation approach that transforms continuous scene and user state data into these texts, which are then fed into an audio generation model for real-time soundtrack creation. Experimental results demonstrate that MetaBGM effectively generates contextually relevant and dynamic background music for interactive applications.
Painful intelligence: What AI can tell us about human suffering
This book uses the modern theory of artificial intelligence (AI) to understand human suffering or mental pain. Both humans and sophisticated AI agents process information about the world in order to achieve goals and obtain rewards, which is why AI can be used as a model of the human brain and mind. This book intends to make the theory accessible to a relatively general audience, requiring only some relevant scientific background. The book starts with the assumption that suffering is mainly caused by frustration. Frustration means the failure of an agent (whether AI or human) to achieve a goal or a reward it wanted or expected. Frustration is inevitable because of the overwhelming complexity of the world, limited computational resources, and scarcity of good data. In particular, such limitations imply that an agent acting in the real world must cope with uncontrollability, unpredictability, and uncertainty, which all lead to frustration. Fundamental in such modelling is the idea of learning, or adaptation to the environment. While AI uses machine learning, humans and animals adapt by a combination of evolutionary mechanisms and ordinary learning. Even frustration is fundamentally an error signal that the system uses for learning. This book explores various aspects and limitations of learning algorithms and their implications regarding suffering. At the end of the book, the computational theory is used to derive various interventions or training methods that will reduce suffering in humans. The amount of frustration is expressed by a simple equation which indicates how it can be reduced. The ensuing interventions are very similar to those proposed by Buddhist and Stoic philosophy, and include mindfulness meditation. Therefore, this book can be interpreted as an exposition of a computational theory justifying why such philosophies and meditation reduce human suffering.