Goto

Collaborating Authors

 Personal Assistant Systems


Reproducibility and Artifact Consistency of the SIGIR 2022 Recommender Systems Papers Based on Message Passing

arXiv.org Artificial Intelligence

Graph-based techniques relying on neural networks and embeddings have gained attention as a way to develop Recommender Systems (RS) with several papers on the topic presented at SIGIR 2022 and 2023. Given the importance of ensuring that published research is methodologically sound and reproducible, in this paper we analyze 10 graph-based RS papers, most of which were published at SIGIR 2022, and assess their impact on subsequent work published in SIGIR 2023. Our analysis reveals several critical points that require attention: (i) the prevalence of bad practices, such as erroneous data splits or information leakage between training and testing data, which call into question the validity of the results; (ii) frequent inconsistencies between the provided artifacts (source code and data) and their descriptions in the paper, causing uncertainty about what is actually being evaluated; and (iii) the preference for new or complex baselines that are weaker compared to simpler ones, creating the impression of continuous improvement even when, particularly for the Amazon-Book dataset, the state-of-the-art has significantly worsened. Due to these issues, we are unable to confirm the claims made in most of the papers we examined and attempted to reproduce.


Decision-Dependent Stochastic Optimization: The Role of Distribution Dynamics

arXiv.org Artificial Intelligence

Distribution shifts have long been regarded as troublesome external forces that a decision-maker should either counteract or conform to. An intriguing feedback phenomenon termed decision dependence arises when the deployed decision affects the environment and alters the data-generating distribution. In the realm of performative prediction, this is encoded by distribution maps parameterized by decisions due to strategic behaviors. In contrast, we formalize an endogenous distribution shift as a feedback process featuring nonlinear dynamics that couple the evolving distribution with the decision. Stochastic optimization in this dynamic regime provides a fertile ground to examine the various roles played by dynamics in the composite problem structure. To this end, we develop an online algorithm that achieves optimal decision-making by both adapting to and shaping the dynamic distribution. Throughout the paper, we adopt a distributional perspective and demonstrate how this view facilitates characterizations of distribution dynamics and the optimality and generalization performance of the proposed algorithm. We showcase the theoretical results in an opinion dynamics context, where an opportunistic party maximizes the affinity of a dynamic polarized population, and in a recommender system scenario, featuring performance optimization with discrete distributions in the probability simplex.


Apple's rumored smart home hub has reportedly been delayed

Engadget

It may be a while still before we see the smart home hub Apple is rumored to be working on. According to Bloomberg's Mark Gurman, the company has postponed the announcement of the upcoming product due to the issues it's run into developing its "smarter" Siri. Gurman reported last month that the release of Apple's upgraded Siri may be delayed, and Apple confirmed as much in a statement to Daring Fireball last week, saying it expects to roll out Siri's more personalized features "in the coming year." The smart home hub, according to Gurman, "to an extent, relies on the delayed Siri capabilities." Gurman previously reported that the first version of the smart home display could be revealed as soon as March.


Graph Retrieval-Augmented LLM for Conversational Recommendation Systems

arXiv.org Artificial Intelligence

Conversational Recommender Systems (CRSs) have emerged as a transformative paradigm for offering personalized recommendations through natural language dialogue. However, they face challenges with knowledge sparsity, as users often provide brief, incomplete preference statements. While recent methods have integrated external knowledge sources to mitigate this, they still struggle with semantic understanding and complex preference reasoning. Recent Large Language Models (LLMs) demonstrate promising capabilities in natural language understanding and reasoning, showing significant potential for CRSs. Nevertheless, due to the lack of domain knowledge, existing LLM-based CRSs either produce hallucinated recommendations or demand expensive domain-specific training, which largely limits their applicability. In this work, we present G-CRS (Graph Retrieval-Augmented Large Language Model for Conversational Recommender Systems), a novel training-free framework that combines graph retrieval-augmented generation and in-context learning to enhance LLMs' recommendation capabilities. Specifically, G-CRS employs a two-stage retrieve-and-recommend architecture, where a GNN-based graph reasoner first identifies candidate items, followed by Personalized PageRank exploration to jointly discover potential items and similar user interactions. These retrieved contexts are then transformed into structured prompts for LLM reasoning, enabling contextually grounded recommendations without task-specific training. Extensive experiments on two public datasets show that G-CRS achieves superior recommendation performance compared to existing methods without requiring task-specific training.


Image is All You Need: Towards Efficient and Effective Large Language Model-Based Recommender Systems

arXiv.org Artificial Intelligence

Large Language Models (LLMs) have recently emerged as a powerful backbone for recommender systems. Existing LLM-based recommender systems take two different approaches for representing items in natural language, i.e., Attribute-based Representation and Description-based Representation. In this work, we aim to address the trade-off between efficiency and effectiveness that these two approaches encounter, when representing items consumed by users. Based on our interesting observation that there is a significant information overlap between images and descriptions associated with items, we propose a novel method, Image is all you need for LLM-based Recommender system (I-LLMRec). Our main idea is to leverage images as an alternative to lengthy textual descriptions for representing items, aiming at reducing token usage while preserving the rich semantic information of item descriptions. Through extensive experiments, we demonstrate that I-LLMRec outperforms existing methods in both efficiency and effectiveness by leveraging images. Moreover, a further appeal of I-LLMRec is its ability to reduce sensitivity to noise in descriptions, leading to more robust recommendations.


InterFeedback: Unveiling Interactive Intelligence of Large Multimodal Models via Human Feedback

arXiv.org Artificial Intelligence

Existing benchmarks do not test Large Multimodal Models (LMMs) on their interactive intelligence with human users, which is vital for developing generalpurpose AI assistants. We design InterFeedback, an interactive framework, which can be applied to any LMM and dataset to assess this ability autonomously. On top of this, we introduce InterFeedback-Bench that evaluates interactive intelligence using two representative datasets, MMMU-Pro and MathVerse, to test 10 different open-source LMMs. Additionally, we present InterFeedback-Human, a newly collected dataset of 120 cases designed for manually testing interactive performance in leading models such as OpenAI-o1 and Claude-3.5-Sonnet. Our evaluation results indicate that even the state-of-the-art LMM, OpenAI-o1, struggles to refine its responses based on human feedback, achieving an average score of less than 50%. Our findings point to the need for methods that can enhance LMMs' capabilities to interpret and benefit from feedback. In this paper, we are curious about the question "Can Large Multimodal Models evolve through Interactive Human Feedback?" It is central to developing general-purpose AI assistants with Large Multimodal Models (LMMs). While these models show exceptional performance on tackling multimodal tasks directly, their ability to interact with humans remains largely unknown. We argue that an LMM functioning as the general assistant should possess two capabilities: 1) exceptional problem-solving ability and 2) the ability to improve itself through feedback (e.g., human feedback, execution results).


A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Models

arXiv.org Artificial Intelligence

Deep Reinforcement Learning (RL) has been explored and verified to be effective in solving decision-making tasks in various domains, such as robotics, transportation, recommender systems, etc. It learns from the interaction with environments and updates the policy using the collected experience. However, due to the limited real-world data and unbearable consequences of taking detrimental actions, the learning of RL policy is mainly restricted within the simulators. This practice guarantees safety in learning but introduces an inevitable sim-to-real gap in terms of deployment, thus causing degraded performance and risks in execution. There are attempts to solve the sim-to-real problems from different domains with various techniques, especially in the era with emerging techniques such as large foundations or language models that have cast light on the sim-to-real. This survey paper, to the best of our knowledge, is the first taxonomy that formally frames the sim-to-real techniques from key elements of the Markov Decision Process (State, Action, Transition, and Reward). Based on the framework, we cover comprehensive literature from the classic to the most advanced methods including the sim-to-real techniques empowered by foundation models, and we also discuss the specialties that are worth attention in different domains of sim-to-real problems. Then we summarize the formal evaluation process of sim-to-real performance with accessible code or benchmarks. The challenges and opportunities are also presented to encourage future exploration of this direction. We are actively maintaining a repository to include the most up-to-date sim-to-real research work to help domain researchers.


Apple is delaying its smarter, more personal Siri

Engadget

Apple is delaying its updated version of Siri that understands personal context and can take action inside of apps, according to a statement the company shared with Daring Fireball. The company didn't offer a date as to when the upgrades to Siri will actually launch beyond that they're "rolling them out in the coming year." Here's the full statement reproduced below: Siri helps our users find what they need and get things done quickly, and in just the past six months, we've made Siri more conversational, introduced new features like type to Siri and product knowledge, and added an integration with ChatGPT. We've also been working on a more personalized Siri, giving it more awareness of your personal context, as well as the ability to take action for you within and across your apps. It's going to take us longer than we thought to deliver on these features and we anticipate rolling them out in the coming year.


Best Sonos Speakers (2025): Soundbars, Turntables, and More

WIRED

After flooding our homes with every Sonos model you can buy (and filling all remaining space with the boxes of said speakers), then using them for a couple of years, we've come to value their audio fidelity and ability to network seamlessly together. There isn't another speaker system that lets you string together multiple speakers as easily or connect them to stream in different rooms of your home while keeping the audio perfectly in sync. The closest thing may be Google Assistant speakers, and Sonos connects to that system as well. Easy streaming: The Sonos app supports almost every streaming service in existence, and many apps, like Spotify, let you stream to Sonos speakers within them. The Sonos ecosystem can also handle home-theater applications and can support a full surround-sound setup.


Can Matchmaking Platforms Save Us From Dating App Fatigue?

WIRED

One might assume, with good reason, that a romantic recession is underway. That's the story the numbers tell, at least. Forty-seven percent of US adults say dating is more difficult today than it was a decade ago, according to a Pew Research Center analysis. Even as singledom is on a downward slope--in 2023, 42 percent of adults were unpartnered compared to 44 percent in 2019, a different Pew survey found--it doesn't feel that way. The dating landscape is in the throes of another tectonic shift.