Goto

Collaborating Authors

 Media


Reindex-Then-Adapt: Improving Large Language Models for Conversational Recommendation

arXiv.org Artificial Intelligence

Large language models (LLMs) are revolutionizing conversational recommender systems by adeptly indexing item content, understanding complex conversational contexts, and generating relevant item titles. However, controlling the distribution of recommended items remains a challenge. This leads to suboptimal performance due to the failure to capture rapidly changing data distributions, such as item popularity, on targeted conversational recommendation platforms. In conversational recommendation, LLMs recommend items by generating the titles (as multiple tokens) autoregressively, making it difficult to obtain and control the recommendations over all items. Thus, we propose a Reindex-Then-Adapt (RTA) framework, which converts multi-token item titles into single tokens within LLMs, and then adjusts the probability distributions over these single-token item titles accordingly. The RTA framework marries the benefits of both LLMs and traditional recommender systems (RecSys): understanding complex queries as LLMs do; while efficiently controlling the recommended item distributions in conversational recommendations as traditional RecSys do. Our framework demonstrates improved accuracy metrics across three different conversational recommendation datasets and two adaptation settings


The MovieLens Beliefs Dataset: Collecting Pre-Choice Data for Online Recommender Systems

arXiv.org Artificial Intelligence

An increasingly important aspect of designing recommender systems involves considering how recommendations will influence consumer choices. This paper addresses this issue by introducing a method for collecting user beliefs about un-experienced items - a critical predictor of choice behavior. We implemented this method on the MovieLens platform, resulting in a rich dataset that combines user ratings, beliefs, and observed recommendations. We document challenges to such data collection, including selection bias in response and limited coverage of the product space. This unique resource empowers researchers to delve deeper into user behavior and analyze user choices absent recommendations, measure the effectiveness of recommendations, and prototype algorithms that leverage user belief data, ultimately leading to more impactful recommender systems. The dataset can be found at https://grouplens.org/datasets/movielens/ml_belief_2024/.


Modeling citation worthiness by using attention-based bidirectional long short-term memory networks and interpretable models

arXiv.org Artificial Intelligence

Scientist learn early on how to cite scientific sources to support their claims. Sometimes, however, scientists have challenges determining where a citation should be situated -- or, even worse, fail to cite a source altogether. Automatically detecting sentences that need a citation (i.e., citation worthiness) could solve both of these issues, leading to more robust and well-constructed scientific arguments. Previous researchers have applied machine learning to this task but have used small datasets and models that do not take advantage of recent algorithmic developments such as attention mechanisms in deep learning. We hypothesize that we can develop significantly accurate deep learning architectures that learn from large supervised datasets constructed from open access publications. In this work, we propose a Bidirectional Long Short-Term Memory (BiLSTM) network with attention mechanism and contextual information to detect sentences that need citations. We also produce a new, large dataset (PMOA-CITE) based on PubMed Open Access Subset, which is orders of magnitude larger than previous datasets. Our experiments show that our architecture achieves state of the art performance on the standard ACL-ARC dataset ($F_{1}=0.507$) and exhibits high performance ($F_{1}=0.856$) on the new PMOA-CITE. Moreover, we show that it can transfer learning across these datasets. We further use interpretable models to illuminate how specific language is used to promote and inhibit citations. We discover that sections and surrounding sentences are crucial for our improved predictions. We further examined purported mispredictions of the model, and uncovered systematic human mistakes in citation behavior and source data. This opens the door for our model to check documents during pre-submission and pre-archival procedures. We make this new dataset, the code, and a web-based tool available to the community.


CofiPara: A Coarse-to-fine Paradigm for Multimodal Sarcasm Target Identification with Large Multimodal Models

arXiv.org Artificial Intelligence

Social media abounds with multimodal sarcasm, and identifying sarcasm targets is particularly challenging due to the implicit incongruity not directly evident in the text and image modalities. Current methods for Multimodal Sarcasm Target Identification (MSTI) predominantly focus on superficial indicators in an end-to-end manner, overlooking the nuanced understanding of multimodal sarcasm conveyed through both the text and image. This paper proposes a versatile MSTI framework with a coarse-to-fine paradigm, by augmenting sarcasm explainability with reasoning and pre-training knowledge. Inspired by the powerful capacity of Large Multimodal Models (LMMs) on multimodal reasoning, we first engage LMMs to generate competing rationales for coarser-grained pre-training of a small language model on multimodal sarcasm detection. We then propose fine-tuning the model for finer-grained sarcasm target identification. Our framework is thus empowered to adeptly unveil the intricate targets within multimodal sarcasm and mitigate the negative impact posed by potential noise inherently in LMMs. Experimental results demonstrate that our model far outperforms state-of-the-art MSTI methods, and markedly exhibits explainability in deciphering sarcasm as well.


A Novel Method for News Article Event-Based Embedding

arXiv.org Artificial Intelligence

Embedding news articles is a crucial tool for multiple fields, such as media bias detection, identifying fake news, and news recommendations. However, existing news embedding methods are not optimized for capturing the latent context of news events. In many cases, news embedding methods rely on full-textual information and neglect the importance of time-relevant embedding generation. Here, we aim to address these shortcomings by presenting a novel lightweight method that optimizes news embedding generation by focusing on the entities and themes mentioned in the articles and their historical connections to specific events. We suggest a method composed of three stages. First, we process and extract the events, entities, and themes for the given news articles. Second, we generate periodic time embeddings for themes and entities by training timely separated GloVe models on current and historical data. Lastly, we concatenate the news embeddings generated by two distinct approaches: Smooth Inverse Frequency (SIF) for article-level vectors and Siamese Neural Networks for embeddings with nuanced event-related information. To test and evaluate our method, we leveraged over 850,000 news articles and 1,000,000 events from the GDELT project. For validation purposes, we conducted a comparative analysis of different news embedding generation methods, applying them twice to a shared event detection task - first on articles published within the same day and subsequently on those published within the same month. Our experiments show that our method significantly improves the Precision-Recall (PR) AUC across all tasks and datasets. Specifically, we observed an average PR AUC improvement of 2.15% and 2.57% compared to SIF, as well as 2.57% and 2.43% compared to the semi-supervised approach for daily and monthly shared event detection tasks, respectively.


Text-to-Song: Towards Controllable Music Generation Incorporating Vocals and Accompaniment

arXiv.org Artificial Intelligence

A song is a combination of singing voice and accompaniment. However, existing works focus on singing voice synthesis and music generation independently. Little attention was paid to explore song synthesis. In this work, we propose a novel task called text-to-song synthesis which incorporating both vocals and accompaniments generation. We develop Melodist, a two-stage text-to-song method that consists of singing voice synthesis (SVS) and vocal-to-accompaniment (V2A) synthesis. Melodist leverages tri-tower contrastive pretraining to learn more effective text representation for controllable V2A synthesis. A Chinese song dataset mined from a music website is built up to alleviate data scarcity for our research. The evaluation results on our dataset demonstrate that Melodist can synthesize songs with comparable quality and style consistency. Audio samples can be found in https://text2songMelodist.github.io/Sample/.


SNL's' Colin Jost forced to crack joke about wife Scarlett Johansson's body on 'Weekend Update'

FOX News

The season finale of "Saturday Night Live" went out with a bang last night, featuring its traditional joke swap segment on "Weekend Update." Hosts Colin Jost and Michael Che were forced to read jokes written by the other, making for some uncomfortable moments. A little ways into the segment, Jost uttered an, "Oh God," after realizing he'd have to take a crack at his wife, Scarlett Johansson. "ChatGPT has released a new voice assistant feature inspired by Scarlett Johansson's AI character in'Her,' which I've never bothered to watch because without that body, what's the point of listening," Jost said, much to his embarrassment. Colin Jost was forced to make a joke about his wife Scarlett Johanssons body during the "Weekend Update" segment of "Saturday Night Live." (SNL YouTube) The 2013 flick stars Joaquin Phoenix as a man who falls in love with his AI device, Samantha, played by Johansson.


7 things Google just announced that are worth keeping a close eye on

FOX News

ZeroEyes CEO Mike Lahiff joins'Fox & Friends' to explain how the technology works to help keep students safe in schools. Google's flagship developer conference called I/O just wrapped up with interesting leaps in how the Big Tech giant is planning to change the world. Here are the seven biggest things we learned from Google at I/O 2024. Google's I/O event was largely an opportunity for it to make its case to developers -- and, to a lesser extent, consumers -- as to why its artificial intelligence is ahead of rivals Microsoft and OpenAI. Here's a rundown of the seven highlights to keep an eye on.


Spam, junk … slop? The latest wave of AI behind the 'zombie internet'

The Guardian

Your email inbox is full of spam. Your letterbox is full of junk mail. Now, your web browser has its own affliction: slop. "Slop" is what you get when you shove artificial intelligence-generated material up on the web for anyone to view. Unlike a chatbot, the slop isn't interactive, and is rarely intended to actually answer readers' questions or serve their needs.


Google remains focused on its long quest for your eyeballs

The Guardian

Google announced this week that it would begin the international rollout of its new artificial intelligence-powered search feature, called AI Overviews. When billions of people search a range of topics from news to recipes to general knowledge questions, what they see first will now be an AI-generated summary. Google touted AI Overviews at its annual I/O developer conference as a way of delivering customers quick answers and simplifying the online search experience, but it also has another effect on the way that people engage with the internet: keeping users, and advertisers, on Google.com. "Google will do the googling for you," said Liz Reid, head of Google Search. While Google was once mostly a portal to reach other parts of the internet, it has spent years consolidating content and services to make itself into the web's primary destination.