Goto

Collaborating Authors

 Personal Assistant Systems


Apple to pay 95m to settle Siri 'listening' lawsuit

BBC News

In the preliminary settlement, the tech firm denies any wrongdoing, as well as claims that it "recorded, disclosed to third parties, or failed to delete, conversations recorded as the result of a Siri activation" without consent. Apple's lawyers also say they will confirm they have "permanently deleted individual Siri audio recordings collected by Apple prior to October 2019". But the claimants say the tech firm recorded people who activated the virtual assistant unintentionally - without using the phrase "Hey, Siri" to wake it. They say advertisers who received the recordings could then look for keywords in them to better target ads. The lead plaintiff Fumiko Lopez claims she and her daughter were both recorded without their consent.


The Efficiency vs. Accuracy Trade-off: Optimizing RAG-Enhanced LLM Recommender Systems Using Multi-Head Early Exit

arXiv.org Artificial Intelligence

The deployment of Large Language Models (LLMs) in recommender systems for predicting Click-Through Rates (CTR) necessitates a delicate balance between computational efficiency and predictive accuracy. This paper presents an optimization framework that combines Retrieval-Augmented Generation (RAG) with an innovative multi-head early exit architecture to concurrently enhance both aspects. By integrating Graph Convolutional Networks (GCNs) as efficient retrieval mechanisms, we are able to significantly reduce data retrieval times while maintaining high model performance. The early exit strategy employed allows for dynamic termination of model inference, utilizing real-time predictive confidence assessments across multiple heads. This not only quickens the responsiveness of LLMs but also upholds or improves their accuracy, making it ideal for real-time application scenarios. Our experiments demonstrate how this architecture effectively decreases computation time without sacrificing the accuracy needed for reliable recommendation delivery, establishing a new standard for efficient, real-time LLM deployment in commercial systems.


Recommender systems and reinforcement learning for human-building interaction and context-aware support: A text mining-driven review of scientific literature

arXiv.org Artificial Intelligence

The indoor environment significantly impacts human health and well-being; enhancing health and reducing energy consumption in these settings is a central research focus. With the advancement of Information and Communication Technology (ICT), recommendation systems and reinforcement learning (RL) have emerged as promising approaches to induce behavioral changes to improve the indoor environment and energy efficiency of buildings. This study aims to employ text mining and Natural Language Processing (NLP) techniques to thoroughly examine the connections among these approaches in the context of human-building interaction and occupant context-aware support. The study analyzed 27,595 articles from the ScienceDirect database, revealing extensive use of recommendation systems and RL for space optimization, location recommendations, and personalized control suggestions. Furthermore, this review underscores the vast potential for expanding recommender systems and RL applications in buildings and indoor environments. Fields ripe for innovation include predictive maintenance, building-related product recommendation, and optimization of environments tailored for specific needs, such as sleep and productivity enhancements based on user feedback. The study also notes the limitations of the method in capturing subtle academic nuances. Future improvements could involve integrating and fine-tuning pre-trained language models to better interpret complex texts.


Apple agrees to settle a 2019 Siri privacy lawsuit for 95 million

Engadget

Apple has moved to settle a five-year-old class action lawsuit over Siri privacy. Reuters reports that the proposed settlement was filed on Tuesday in Oakland, CA. The company agreed to pay 95 million to class members, estimated to be tens of millions of Siri-enabled device owners. US District Judge Jeffrey White needs to approve the settlement before it becomes official. The lawsuit stemmed from a 2019 report that Apple quality control contractors could regularly hear sensitive info accidentally recorded by the voice assistant's "Hey Siri" feature. The clips were said to include medical information, criminal activities and even "sexual encounters."


Amazon's newest Echo Show is 50% off and includes a smart bulb

PCWorld

Right now, you can grab an Amazon Echo Show 5 bundle for just 46.98, which amounts to the Echo Show 5 at 50 percent off along with a near-free 60W A19 smart bulb that's controllable via the Echo Show. The beauty of the Echo Show 5 is that it's a fairly inexpensive way to bring a smart screen assistant into your home. With a 5-inch display that shows everything from the current time and date to your active Spotify playlist to the results to your voice queries and even your smart doorbell's live video feed, the Echo Show serves perfectly anywhere in your home. You can ask Alexa to control the light bulb that comes with it, play music, read out recipes, turn off your compatible smart TV, and more. If you dive in deeper, you can even create custom Alexa routines so when you say something like "Alexa, good night," it responds by turning off the lights and the TV for you.


Contrastive Learning from Exploratory Actions: Leveraging Natural Interactions for Preference Elicitation

arXiv.org Artificial Intelligence

People have a variety of preferences for how robots behave. To understand and reason about these preferences, robots aim to learn a reward function that describes how aligned robot behaviors are with a user's preferences. Good representations of a robot's behavior can significantly reduce the time and effort required for a user to teach the robot their preferences. Specifying these representations -- what "features" of the robot's behavior matter to users -- remains a difficult problem; Features learned from raw data lack semantic meaning and features learned from user data require users to engage in tedious labeling processes. Our key insight is that users tasked with customizing a robot are intrinsically motivated to produce labels through exploratory search; they explore behaviors that they find interesting and ignore behaviors that are irrelevant. To harness this novel data source of exploratory actions, we propose contrastive learning from exploratory actions (CLEA) to learn trajectory features that are aligned with features that users care about. We learned CLEA features from exploratory actions users performed in an open-ended signal design activity (N=25) with a Kuri robot, and evaluated CLEA features through a second user study with a different set of users (N=42). CLEA features outperformed self-supervised features when eliciting user preferences over four metrics: completeness, simplicity, minimality, and explainability.


An Efficient Attention Mechanism for Sequential Recommendation Tasks: HydraRec

arXiv.org Artificial Intelligence

Transformer based models are increasingly being used in various domains including recommender systems (RS). Pretrained transformer models such as BERT have shown good performance at language modelling. With the greater ability to model sequential tasks, variants of Encoder-only models (like BERT4Rec, SASRec etc.) have found success in sequential RS problems. Computing dot-product attention in traditional transformer models has quadratic complexity in sequence length. This is a bigger problem with RS because unlike language models, new items are added to the catalogue every day. User buying history is a dynamic sequence which depends on multiple factors. Recently, various linear attention models have tried to solve this problem by making the model linear in sequence length (token dimensions). Hydra attention is one such linear complexity model proposed for vision transformers which reduces the complexity of attention for both the number of tokens as well as model embedding dimensions. Building on the idea of Hydra attention, we introduce an efficient Transformer based Sequential RS (HydraRec) which significantly improves theoretical complexity of computing attention for longer sequences and bigger datasets while preserving the temporal context. Extensive experiments are conducted to evaluate other linear transformer-based RS models and compared with HydraRec across various evaluation metrics. HydraRec outperforms other linear attention-based models as well as dot-product based attention models when used with causal masking for sequential recommendation next item prediction tasks. For bi-directional models its performance is comparable to the BERT4Rec model with an improvement in running time.


From Models to Systems: A Comprehensive Fairness Framework for Compositional Recommender Systems

arXiv.org Artificial Intelligence

Fairness research in machine learning often centers on ensuring equitable performance of individual models. However, real-world recommendation systems are built on multiple models and even multiple stages, from candidate retrieval to scoring and serving, which raises challenges for responsible development and deployment. This system-level view, as highlighted by regulations like the EU AI Act, necessitates moving beyond auditing individual models as independent entities. We propose a holistic framework for modeling system-level fairness, focusing on the end-utility delivered to diverse user groups, and consider interactions between components such as retrieval and scoring models. We provide formal insights on the limitations of focusing solely on model-level fairness and highlight the need for alternative tools that account for heterogeneity in user preferences. To mitigate system-level disparities, we adapt closed-box optimization tools (e.g., BayesOpt) to jointly optimize utility and equity. We empirically demonstrate the effectiveness of our proposed framework on synthetic and real datasets, underscoring the need for a system-level framework.


I'm Newly Divorced and Using Dating Apps. I'm Worried About Coming Across My Son's Profile.

Slate

How to Do It is Slate's sex advice column. Send it to Jessica and Rich here. I am a newly divorced bisexual dad who's moved to a city adjacent to my 20-year-old son's college. He's extremely shy and hasn't talked about sex with me in years. He identifies as queer but has provided no more detail than that.


Satori: Towards Proactive AR Assistant with Belief-Desire-Intention User Modeling

arXiv.org Artificial Intelligence

Augmented Reality assistance are increasingly popular for supporting users with tasks like assembly and cooking. However, current practice typically provide reactive responses initialized from user requests, lacking consideration of rich contextual and user-specific information. To address this limitation, we propose a novel AR assistance system, Satori, that models both user states and environmental contexts to deliver proactive guidance. Our system combines the Belief-Desire-Intention (BDI) model with a state-of-the-art multi-modal large language model (LLM) to infer contextually appropriate guidance. The design is informed by two formative studies involving twelve experts. A sixteen within-subject study find that Satori achieves performance comparable to an designer-created Wizard-of-Oz (WoZ) system without relying on manual configurations or heuristics, thereby enhancing generalizability, reusability and opening up new possibilities for AR assistance.