Goto

Collaborating Authors

 Media


Structure and dynamics of growing networks of Reddit threads

arXiv.org Artificial Intelligence

Millions of people use online social networks to reinforce their sense of belonging, for example by giving and asking for feedback as a form of social validation and self-recognition. It is common to observe disagreement among people beliefs and points of view when expressing this feedback. Modeling and analyzing such interactions is crucial to understand social phenomena that happen when people face different opinions while expressing and discussing their values. In this work, we study a Reddit community in which people participate to judge or be judged with respect to some behavior, as it represents a valuable source to study how users express judgments online. We model threads of this community as complex networks of user interactions growing in time, and we analyze the evolution of their structural properties. We show that the evolution of Reddit networks differ from other real social networks, despite falling in the same category. This happens because their global clustering coefficient is extremely small and the average shortest path length increases over time. Such properties reveal how users discuss in threads, i.e. with mostly one other user and often by a single message. We strengthen such result by analyzing the role that disagreement and reciprocity play in such conversations. We also show that Reddit thread's evolution over time is governed by two subgraphs growing at different speeds. We discover that, in the studied community, the difference of such speed is higher than in other communities because of the user guidelines enforcing specific user interactions. Finally, we interpret the obtained results on user behavior drawing back to Social Judgment Theory.


Prompt-based Personality Profiling: Reinforcement Learning for Relevance Filtering

arXiv.org Artificial Intelligence

Author profiling is the task of inferring characteristics about individuals by analyzing content they share. Supervised machine learning still dominates automatic systems that perform this task, despite the popularity of prompting large language models to address natural language understanding tasks. One reason is that the classification instances consist of large amounts of posts, potentially a whole user profile, which may exceed the input length of Transformers. Even if a model can use a large context window, the entirety of posts makes the application of API-accessed black box systems costly and slow, next to issues which come with such "needle-in-the-haystack" tasks. To mitigate this limitation, we propose a new method for author profiling which aims at distinguishing relevant from irrelevant content first, followed by the actual user profiling only with relevant data. To circumvent the need for relevance-annotated data, we optimize this relevance filter via reinforcement learning with a reward function that utilizes the zero-shot capabilities of large language models. We evaluate our method for Big Five personality trait prediction on two Twitter corpora. On publicly available real-world data with a skewed label distribution, our method shows similar efficacy to using all posts in a user profile, but with a substantially shorter context. An evaluation on a version of these data balanced with artificial posts shows that the filtering to relevant posts leads to a significantly improved accuracy of the predictions.


RLPF: Reinforcement Learning from Prediction Feedback for User Summarization with LLMs

arXiv.org Artificial Intelligence

LLM-powered personalization agent systems employ Large Language Models (LLMs) to predict users' behavior from their past activities. However, their effectiveness often hinges on the ability to effectively leverage extensive, long user historical data due to its inherent noise and length of such data. Existing pretrained LLMs may generate summaries that are concise but lack the necessary context for downstream tasks, hindering their utility in personalization systems. To address these challenges, we introduce Reinforcement Learning from Prediction Feedback (RLPF). RLPF fine-tunes LLMs to generate concise, human-readable user summaries that are optimized for downstream task performance. By maximizing the usefulness of the generated summaries, RLPF effectively distills extensive user history data while preserving essential information for downstream tasks. Our empirical evaluation demonstrates significant improvements in both extrinsic downstream task utility and intrinsic summary quality, surpassing baseline methods by up to 22% on downstream task performance and achieving an up to 84.59% win rate on Factuality, Abstractiveness, and Readability. RLPF also achieves a remarkable 74% reduction in context length while improving performance on 16 out of 19 unseen tasks and/or datasets, showcasing its generalizability. This approach offers a promising solution for enhancing LLM personalization by effectively transforming long, noisy user histories into informative and human-readable representations.


A+AI: Threats to Society, Remedies, and Governance

arXiv.org Artificial Intelligence

This document focuses on the threats, especially near-term threats, that Artificial Intelligence (AI) brings to society. Most of the threats discussed here can result from any algorithmic process, not just AI; in addition, defining AI is notoriously difficult. For both reasons, it is important to think of "A+AI": Algorithms and Artificial Intelligence. In addition to the threats, this paper discusses countermeasures to them, and it includes a table showing which countermeasures are likely to mitigate which threats. Thoughtful governance could manage the risks without seriously impeding progress; in fact, chances are it would accelerate progress by reducing the social chaos that would otherwise be likely.


Man with AI song catalog 'defrauds' streaming services of 10 million

Popular Science

Musicians have long criticized streaming services for their abysmal revenue sharing programs. In 2021, for example, as much as 97 percent of Spotify's over 6 million listed artists earned less than 1,000. Last year, the company announced a new system offering fractions of a cent per track, all of which is now based on even more stringent rules. But there was apparently a way to earn some real dividends from those songs--provided you have access to thousands of bots, hundreds of thousands of AI-generated songs, and are willing to risk receiving a federal grand jury indictment for wire fraud and money laundering. That's what a man named Michael Smith in North Carolina is currently facing, according to a DOJ announcement on September 4. Unsealed filings from US prosecutors accuse Smith of scamming digital streaming platforms including Spotify, Apple Music, Amazon Music, and YouTube Music of over 10 million in royalty payouts between 2017 and 2024.


Alleged fraudster got 10 million in royalties using robots to stream AI-made music

Engadget

A North Carolina man is facing fraud charges after allegedly uploading hundreds of thousands of AI-generated songs to streaming services and using bots to play them billions of times. Michael Smith is said to have received over 10 million in royalties since 2017 via the scheme. Smith, 52, was arrested on Wednesday. An indictment [PDF] that was unsealed the same day accuses him of using the bots to steal royalty payments from platforms including Spotify, Apple Music and Amazon Music. Smith has been charged with wire fraud conspiracy, wire fraud and money laundering conspiracy.


Best podcasts of the week: New Order's rise from the ashes of Joy Division

The Guardian

Origins With Cush Jumbo Widely available, episodes weekly Cush Jumbo is always good fun when doing press interviews for her work (The Good Wife, Criminal Record, Hamlet) โ€“ and she's just as great now the tables are turned in her first podcast. She speaks to stars about their origin stories, including Kate Nash, Harlan Coben, David Schwimmer and, in episode one, Anna Wintour, who says she hates people who waffle and recalls getting fired from Harper's Bazaar because she couldn't pin a dress. Rebel Spirit Widely available, episodes weekly Comedian Akilah Hughes gives her serious mission a light touch as she returns to her Kentucky home town to try to change her high school's racist mascot from a Confederate general to a biscuit. Can she drag the school into the modern age โ€“ and what will the change mean to her and other pupils? Sara & Cariad's Weirdos Book Club Widely available, episodes weekly Sara Pascoe and Cariad Lloyd go beyond the usual selections with season two of their book club for people who don't want to discuss reading over cheese and wine.


Disclosure of AI-Generated News Increases Engagement but Does Not Reduce Aversion, Despite Positive Quality Ratings

arXiv.org Artificial Intelligence

The advancement of artificial intelligence (AI) has led to its application in many areas, including journalism. One key issue is the public's perception of AI-generated content. This preregistered study investigates (i) the perceived quality of AI-assisted and AI-generated versus human-generated news articles, (ii) whether disclosure of AI's involvement in generating these news articles influences engagement with them, and (iii) whether such awareness affects the willingness to read AI-generated articles in the future. We employed a between-subjects survey experiment with 599 participants from the German-speaking part of Switzerland, who evaluated the credibility, readability, and expertise of news articles. These articles were either written by journalists (control group), rewritten by AI (AI-assisted group), or entirely generated by AI (AI-generated group). Our results indicate that all news articles, regardless of whether they were written by journalists or AI, were perceived to be of equal quality. When participants in the treatment groups were subsequently made aware of AI's involvement in generating the articles, they expressed a higher willingness to engage with (i.e., continue reading) the articles than participants in the control group. However, they were not more willing to read AI-generated news in the future. These results suggest that aversion to AI usage in news media is not primarily rooted in a perceived lack of quality, and that by disclosing using AI, journalists could attract more immediate engagement with their content, at least in the short term.


The Role of Generative Systems in Historical Photography Management: A Case Study on Catalan Archives

arXiv.org Artificial Intelligence

The use of image analysis in automated photography management is an increasing trend in heritage institutions. Such tools alleviate the human cost associated with the manual and expensive annotation of new data sources while facilitating fast access to the citizenship through online indexes and search engines. However, available tagging and description tools are usually designed around modern photographs in English, neglecting historical corpora in minoritized languages, each of which exhibits intrinsic particularities. The primary objective of this research is to study the quantitative contribution of generative systems in the description of historical sources. This is done by contextualizing the task of captioning historical photographs from the Catalan archives as a case study. Our findings provide practitioners with tools and directions on transfer learning for captioning models based on visual adaptation and linguistic proximity.


UserSumBench: A Benchmark Framework for Evaluating User Summarization Approaches

arXiv.org Artificial Intelligence

Large language models (LLMs) have shown remarkable capabilities in generating user summaries from a long list of raw user activity data. These summaries capture essential user information such as preferences and interests, and therefore are invaluable for LLM-based personalization applications, such as explainable recommender systems. However, the development of new summarization techniques is hindered by the lack of ground-truth labels, the inherent subjectivity of user summaries, and human evaluation which is often costly and time-consuming. To address these challenges, we introduce \UserSumBench, a benchmark framework designed to facilitate iterative development of LLM-based summarization approaches. This framework offers two key components: (1) A reference-free summary quality metric. We show that this metric is effective and aligned with human preferences across three diverse datasets (MovieLens, Yelp and Amazon Review). (2) A novel robust summarization method that leverages time-hierarchical summarizer and self-critique verifier to produce high-quality summaries while eliminating hallucination. This method serves as a strong baseline for further innovation in summarization techniques.