Personal Assistant Systems
Google smart speakers are starting to sound like Gemini
A smattering of Google Home users are reporting that their Nest speakers are--when asked the right voice command--chatting with a new voice, a sign that the promised Gemini makeover for Google Assistant is starting to roll out. In a video posted on Reddit, a Google Nest Mini user asked "Hey Google, what's up," and got an unusually loquacious reply in a new voice: "What's happening right now is that we're on a giant rock moving through space at 1,000 miles an hour and orbiting a giant star made up mostly of hydrogen. Also, we're chatting, which I enjoy." When the Nest user asked a more basic follow-up question about the weather, Google Assistant answered in its regular voice with a typical weather report. According to 9to5Google, you can tell if the Gemini-enhanced Assistant has made its way to your Nest speakers by asking, "Hey Google, what's up?"
Explainable CTR Prediction via LLM Reasoning
Yu, Xiaohan, Zhang, Li, Chen, Chong
Recommendation Systems have become integral to modern user experiences, but lack transparency in their decision-making processes. Existing explainable recommendation methods are hindered by reliance on a post-hoc paradigm, wherein explanation generators are trained independently of the underlying recommender models. This paradigm necessitates substantial human effort in data construction and raises concerns about explanation reliability. In this paper, we present ExpCTR, a novel framework that integrates large language model based explanation generation directly into the CTR prediction process. Inspired by recent advances in reinforcement learning, we employ two carefully designed reward mechanisms, LC alignment, which ensures explanations reflect user intentions, and IC alignment, which maintains consistency with traditional ID-based CTR models. Our approach incorporates an efficient training paradigm with LoRA and a three-stage iterative process. ExpCTR circumvents the need for extensive explanation datasets while fostering synergy between CTR prediction and explanation generation. Experimental results demonstrate that ExpCTR significantly enhances both recommendation accuracy and interpretability across three real-world datasets.
CADMR: Cross-Attention and Disentangled Learning for Multimodal Recommender Systems
Khalafaoui, Yasser, Lovisetto, Martino, Matei, Basarab, Grozavu, Nistor
The increasing availability and diversity of multimodal data in recommender systems offer new avenues for enhancing recommendation accuracy and user satisfaction. However, these systems must contend with high-dimensional, sparse user-item rating matrices, where reconstructing the matrix with only small subsets of preferred items for each user poses a significant challenge. To address this, we propose CADMR, a novel autoencoder-based multimodal recommender system framework. CADMR leverages multi-head cross-attention mechanisms and Disentangled Learning to effectively integrate and utilize heterogeneous multimodal data in reconstructing the rating matrix. Our approach first disentangles modality-specific features while preserving their interdependence, thereby learning a joint latent representation. The multi-head cross-attention mechanism is then applied to enhance user-item interaction representations with respect to the learned multimodal item latent representations. We evaluate CADMR on three benchmark datasets, demonstrating significant performance improvements over state-of-the-art methods.
Knowledge-Enhanced Conversational Recommendation via Transformer-based Sequential Modelling
Zou, Jie, Sun, Aixin, Long, Cheng, Kanoulas, Evangelos
In conversational recommender systems (CRSs), conversations usually involve a set of items and item-related entities or attributes, e.g., director is a related entity of a movie. These items and item-related entities are often mentioned along the development of a dialog, leading to potential sequential dependencies among them. However, most of existing CRSs neglect these potential sequential dependencies. In this article, we first propose a Transformer-based sequential conversational recommendation method, named TSCR, to model the sequential dependencies in the conversations to improve CRS. In TSCR, we represent conversations by items and the item-related entities, and construct user sequences to discover user preferences by considering both the mentioned items and item-related entities. Based on the constructed sequences, we deploy a Cloze task to predict the recommended items along a sequence. Meanwhile, in certain domains, knowledge graphs formed by the items and their related entities are readily available, which provide various different kinds of associations among them. Given that TSCR does not benefit from such knowledge graphs, we then propose a knowledge graph enhanced version of TSCR, called TSCRKG. In specific, we leverage the knowledge graph to offline initialize our model TSCRKG, and augment the user sequence of conversations (i.e., sequence of the mentioned items and item-related entities in the conversation) with multi-hop paths in the knowledge graph. Experimental results demonstrate that our TSCR model significantly outperforms state-of-the-art baselines, and the enhanced version TSCRKG further improves recommendation performance on top of TSCR.
BGTplanner: Maximizing Training Accuracy for Differentially Private Federated Recommenders via Strategic Privacy Budget Allocation
Zhang, Xianzhi, Zhou, Yipeng, Hu, Miao, Wu, Di, Liao, Pengshan, Guizani, Mohsen, Sheng, Michael
To mitigate the rising concern about privacy leakage, the federated recommender (FR) paradigm emerges, in which decentralized clients co-train the recommendation model without exposing their raw user-item rating data. The differentially private federated recommender (DPFR) further enhances FR by injecting differentially private (DP) noises into clients. Yet, current DPFRs, suffering from noise distortion, cannot achieve satisfactory accuracy. Various efforts have been dedicated to improving DPFRs by adaptively allocating the privacy budget over the learning process. However, due to the intricate relation between privacy budget allocation and model accuracy, existing works are still far from maximizing DPFR accuracy. To address this challenge, we develop BGTplanner (Budget Planner) to strategically allocate the privacy budget for each round of DPFR training, improving overall training performance. Specifically, we leverage the Gaussian process regression and historical information to predict the change in recommendation accuracy with a certain allocated privacy budget. Additionally, Contextual Multi-Armed Bandit (CMAB) is harnessed to make privacy budget allocation decisions by reconciling the current improvement and long-term privacy constraints. Our extensive experimental results on real datasets demonstrate that \emph{BGTplanner} achieves an average improvement of 6.76\% in training performance compared to state-of-the-art baselines.
370 Absolute Best Cyber Monday Deals (2024)
As the sun sets on the Black Friday weekend there are still bargains to be found. Whether you are gift shopping for the holidays or treating yourself, we have all the best Cyber Monday deals for you. We worked tirelessly to filter the noise and tune into the sales worth your attention. So kick back and get ready to bag a bargain. Bringing decades of product testing experience, tempered by price-tracking tools, the WIRED team has cross-referenced our buying guide recommendations with the latest discounts to find only the very best Cyber Monday deals. Someone from the WIRED Reviews team has tested every product we list in our deals coverage, and we don't recommend anything we don't like. We always strive to find deals at their best price ever, or very close to it (some match previous discounts, but we have never seen them lower unless stated). We test products year-round and handpicked these Cyber Monday deals. To find you the best deals, we use a proprietary tool that scans prices on ...
Optimizing LoRa for Edge Computing with TinyML Pipeline for Channel Hopping
Grunewald, Marla, Bensalem, Mounir, Jukan, Admela
We propose to integrate long-distance LongRange (LoRa) communication solution for sending the data from IoT to the edge computing system, by taking advantage of its unlicensed nature and the potential for open source implementations that are common in edge computing. We propose a channel hoping optimization model and apply TinyML-based channel hoping model based for LoRa transmissions, as well as experimentally study a fast predictive algorithm to find free channels between edge and IoT devices. In the open source experimental setup that includes LoRa, TinyML and IoT-edge-cloud continuum, we integrate a novel application workflow and cloud-friendly protocol solutions in a case study of plant recommender application that combines concepts of microfarming and urban computing. In a LoRa-optimized edge computing setup, we engineer the application workflow, and apply collaborative filtering and various machine learning algorithms on application data collected to identify and recommend the planting schedule for a specific microfarm in an urban area. In the LoRa experiments, we measure the occurrence of packet loss, RSSI, and SNR, using a random channel hoping scheme to compare with our proposed TinyML method. The results show that it is feasible to use TinyML in microcontrollers for channel hopping, while proving the effectiveness of TinyML in learning to predict the best channel to select for LoRa transmission, and by improving the RSSI by up to 63 %, SNR by up to 44 % in comparison with a random hopping mechanism.
Convolutional Transformer Neural Collaborative Filtering
Li, Pang, Noah, Shahrul Azman Mohd, Sarim, Hafiz Mohd
In this study, we introduce Convolutional Transformer Neural Collaborative Filtering (CTNCF), a novel approach aimed at enhancing recommendation systems by effectively capturing high-order structural information in user-item interactions. CTNCF represents a significant advancement over the traditional Neural Collaborative Filtering (NCF) model by seamlessly integrating Convolutional Neural Networks (CNNs) and Transformer layers. This sophisticated integration enables the model to adeptly capture and understand complex interaction patterns inherent in recommendation systems. Specifically, CNNs are employed to extract local features from user and item embeddings, allowing the model to capture intricate spatial dependencies within the data. Furthermore, the utilization of Transformer layers enables the model to capture long-range dependencies and interactions among user and item features, thereby enhancing its ability to understand the underlying relationships in the data. To validate the effectiveness of our proposed CTNCF framework, we conduct extensive experiments on two real-world datasets. The results demonstrate that CTNCF significantly outperforms state-of-the-art approaches, highlighting its efficacy in improving recommendation system performance.
Personalized Multimodal Large Language Models: A Survey
Wu, Junda, Lyu, Hanjia, Xia, Yu, Zhang, Zhehao, Barrow, Joe, Kumar, Ishita, Mirtaheri, Mehrnoosh, Chen, Hongjie, Rossi, Ryan A., Dernoncourt, Franck, Yu, Tong, Zhang, Ruiyi, Gu, Jiuxiang, Ahmed, Nesreen K., Wang, Yu, Chen, Xiang, Deilamsalehy, Hanieh, Park, Namyong, Kim, Sungchul, Yang, Huanrui, Mitra, Subrata, Hu, Zhengmian, Lipka, Nedim, Nguyen, Dang, Zhao, Yue, Luo, Jiebo, McAuley, Julian
Multimodal Large Language Models (MLLMs) have become increasingly important due to their state-of-the-art performance and ability to integrate multiple data modalities, such as text, images, and audio, to perform complex tasks with high accuracy. This paper presents a comprehensive survey on personalized multimodal large language models, focusing on their architecture, training methods, and applications. We propose an intuitive taxonomy for categorizing the techniques used to personalize MLLMs to individual users, and discuss the techniques accordingly. Furthermore, we discuss how such techniques can be combined or adapted when appropriate, highlighting their advantages and underlying rationale. We also provide a succinct summary of personalization tasks investigated in existing research, along with the evaluation metrics commonly used. Additionally, we summarize the datasets that are useful for benchmarking personalized MLLMs. Finally, we outline critical open challenges. This survey aims to serve as a valuable resource for researchers and practitioners seeking to understand and advance the development of personalized multimodal large language models.
The best Cyber Monday speaker deals for 2024: Big savings on JBL, Sonos, Echo, Marshall and more
We've tested hundreds of speakers over the years, and we put the best ones into our buying guides -- namely the ones for soundbars, portable Bluetooth speakers and smart speakers. Now that Cyber Monday has arrived, we're seeing notable discounts on many of our top picks. So if you need a soundbar to make the dialogue on your TV clearer or want to take your music out on the porch once the weather warms back up, this is a good time to grab a new music maker. And if you need a speaker to do your bidding (like turning on your smart lights or reminding you to take out the trash) you can save on a smart speaker, too. Here are the best Cyber Monday speaker deals we could find. Portable Bluetooth speakers make it easy for you to bring the music where plugs don't reach -- a picnic, the front stoop, an aimless wander along the Pacific Crest Trail.