Goto

Collaborating Authors

 Media


SHARE: Shared Memory-Aware Open-Domain Long-Term Dialogue Dataset Constructed from Movie Script

arXiv.org Artificial Intelligence

Shared memories between two individuals strengthen their bond and are crucial for facilitating their ongoing conversations. This study aims to make long-term dialogue more engaging by leveraging these shared memories. To this end, we introduce a new long-term dialogue dataset named SHARE, constructed from movie scripts, which are a rich source of shared memories among various relationships. Our dialogue dataset contains the summaries of persona information and events of two individuals, as explicitly revealed in their conversation, along with implicitly extractable shared memories. We also introduce EPISODE, a long-term dialogue framework based on SHARE that utilizes shared experiences between individuals. Through experiments using SHARE, we demonstrate that shared memories between two individuals make long-term dialogues more engaging and sustainable, and that EPISODE effectively manages shared memories during dialogue. Our new dataset is publicly available at https://anonymous.4open.science/r/SHARE-AA1E/SHARE.json.


Geometric Collaborative Filtering with Convergence

arXiv.org Artificial Intelligence

Latent variable collaborative filtering methods have been a standard approach to modelling user-click interactions due to their simplicity and effectiveness. However, there is limited work on analyzing the mathematical properties of these methods in particular on preventing the overfitting towards the identity, and such methods typically utilize loss functions that overlook the geometry between items. In this work, we introduce a notion of generalization gap in collaborative filtering and analyze this with respect to latent collaborative filtering models. We present a geometric upper bound that gives rise to loss functions, and a way to meaningfully utilize the geometry of item-metadata to improve recommendations. We show how these losses can be minimized and gives the recipe to a new latent collaborative filtering algorithm, which we refer to as GeoCF, due to the geometric nature of our results. We then show experimentally that our proposed GeoCF algorithm can outperform other all existing methods on the Movielens20M and Netflix datasets, as well as two large-scale internal datasets. In summary, our work proposes a theoretically sound method which paves a way to better understand generalization of collaborative filtering at large.


Rise of the killer robots: Experts reveal just how close we are to a Terminator-style takeover

Daily Mail - Science & tech

It's been exactly 40 years since The Terminator hit the big screen, shocking cinemagoers with its terrifying depiction of a post-apocalyptic future. In James Cameron's epic sci-fi blockbuster, billions of people are killed when self-aware machines trigger a global nuclear war around the start of the 21st century. Arnold Schwarzenegger stars as the eponymous robotic assassin sent back in time from 2029 to 1984 to eliminate the threat of a human resistance. Famously, the Terminator, which looks just like an adult human, 'absolutely will not stop โ€ฆ until you are dead', as one character puts it. While this sounds like pure sci-fi, academic and industry figures โ€“ including Elon Musk โ€“ fear that humanity will indeed be annihilated by AI. But when exactly will this happen?


Model Equality Testing: Which Model Is This API Serving?

arXiv.org Artificial Intelligence

Users often interact with large language models through black-box inference APIs, both for closed- and open-weight models (e.g., Llama models are popularly accessed via Amazon Bedrock and Azure AI Studio). In order to cut costs or add functionality, API providers may quantize, watermark, or finetune the underlying model, changing the output distribution -- often without notifying users. We formalize detecting such distortions as Model Equality Testing, a two-sample testing problem, where the user collects samples from the API and a reference distribution and conducts a statistical test to see if the two distributions are the same. We find that tests based on the Maximum Mean Discrepancy between distributions are powerful for this task: a test built on a simple string kernel achieves a median of 77.4% power against a range of distortions, using an average of just 10 samples per prompt. We then apply this test to commercial inference APIs for four Llama models, finding that 11 out of 31 endpoints serve different distributions than reference weights released by Meta.


A Survey of Large Language Models for Arabic Language and its Dialects

arXiv.org Artificial Intelligence

This survey offers a comprehensive overview of Large Language Models (LLMs) designed for Arabic language and its dialects. It covers key architectures, including encoder-only, decoder-only, and encoder-decoder models, along with the datasets used for pre-training, spanning Classical Arabic, Modern Standard Arabic, and Dialectal Arabic. The study also explores monolingual, bilingual, and multilingual LLMs, analyzing their architectures and performance across downstream tasks, such as sentiment analysis, named entity recognition, and question answering. Furthermore, it assesses the openness of Arabic LLMs based on factors, such as source code availability, training data, model weights, and documentation. The survey highlights the need for more diverse dialectal datasets and attributes the importance of openness for research reproducibility and transparency. It concludes by identifying key challenges and opportunities for future research and stressing the need for more inclusive and representative models.


MAD-Sherlock: Multi-Agent Debates for Out-of-Context Misinformation Detection

arXiv.org Artificial Intelligence

One of the most challenging forms of misinformation involves the out-of-context (OOC) use of images paired with misleading text, creating false narratives. Existing AI-driven detection systems lack explainability and require expensive fine-tuning. We address these issues with MAD-Sherlock: a Multi-Agent Debate system for OOC Misinformation Detection. MAD-Sherlock introduces a novel multi-agent debate framework where multimodal agents collaborate to assess contextual consistency and request external information to enhance cross-context reasoning and decision-making. Our framework enables explainable detection with state-of-the-art accuracy even without domain-specific fine-tuning. Extensive ablation studies confirm that external retrieval significantly improves detection accuracy, and user studies demonstrate that MAD-Sherlock boosts performance for both experts and non-experts. These results position MAD-Sherlock as a powerful tool for autonomous and citizen intelligence applications.


CrediRAG: Network-Augmented Credibility-Based Retrieval for Misinformation Detection in Reddit

arXiv.org Artificial Intelligence

Fake news threatens democracy and exacerbates the polarization and divisions in society; therefore, accurately detecting online misinformation is the foundation of addressing this issue. We present CrediRAG, the first fake news detection model that combines language models with access to a rich external political knowledge base with a dense social network to detect fake news across social media at scale. CrediRAG uses a news retriever to initially assign a misinformation score to each post based on the source credibility of similar news articles to the post title content. CrediRAG then improves the initial retrieval estimations through a novel weighted post-to-post network connected based on shared commenters and weighted by the average stance of all shared commenters across every pair of posts. We achieve 11% increase in the F1-score in detecting misinformative posts over state-of-the-art methods. Extensive experiments conducted on curated real-world Reddit data of over 200,000 posts demonstrate the superior performance of CrediRAG on existing baselines. Thus, our approach offers a more accurate and scalable solution to combat the spread of fake news across social media platforms.


UniHGKR: Unified Instruction-aware Heterogeneous Knowledge Retrievers

arXiv.org Artificial Intelligence

Existing information retrieval (IR) models often assume a homogeneous structure for knowledge sources and user queries, limiting their applicability in real-world settings where retrieval is inherently heterogeneous and diverse. In this paper, we introduce UniHGKR, a unified instruction-aware heterogeneous knowledge retriever that (1) builds a unified retrieval space for heterogeneous knowledge and (2) follows diverse user instructions to retrieve knowledge of specified types. UniHGKR consists of three principal stages: heterogeneous self-supervised pretraining, text-anchored embedding alignment, and instruction-aware retriever fine-tuning, enabling it to generalize across varied retrieval contexts. This framework is highly scalable, with a BERT-based version and a UniHGKR-7B version trained on large language models. Also, we introduce CompMix-IR, the first native heterogeneous knowledge retrieval benchmark. It includes two retrieval scenarios with various instructions, over 9,400 question-answer (QA) pairs, and a corpus of 10 million entries, covering four different types of data. Extensive experiments show that UniHGKR consistently outperforms state-of-the-art methods on CompMix-IR, achieving up to 6.36% and 54.23% relative improvements in two scenarios, respectively. Finally, by equipping our retriever for open-domain heterogeneous QA systems, we achieve a new state-of-the-art result on the popular ConvMix task, with an absolute improvement of up to 4.80 points.


'Unjust threat': Murdoch and artists align in fight over AI content scraping

The Guardian

It is an unlikely alliance: the billionaire media mogul Rupert Murdoch and a panoply of leading artists including the Radiohead singer, Thom Yorke, the actors Kevin Bacon and Julianne Moore, and the author Kazuo Ishiguro. This week, they began two very public fights with artificial intelligence companies, accusing them of using their intellectual property without permission to build the increasingly powerful and lucrative new technology. More than 13,000 creative professionals from the worlds of literature, music, film, theatre and television released a statement warning that AI firms training programs such as ChatGPT on their works without a licence posed a "major, unjust threat" to their livelihoods. By the end of the week that number had almost doubled to 25,000. It came a day after Murdoch, owner of the publishing group News Corp, whose newspapers include the Wall Street Journal, the Sun, the Times and the Australian, launched a legal action against the AI-powered search engine Perplexity, accusing it of "illegally copying" some of his US titles' journalism.


How Fear the Spotlight became Blumhouse's first video game

Engadget

Blumhouse wasn't going to publish a game in 2024. The studio, one of the leading names in horror films, announced in February 2023 that it was launching a video game publishing business and executives were scouting projects from independent teams with budgets under 10 million. The goal of Blumhouse Games was to support a few rad horror titles per year, with a tentative plan to start publishing them in 2025. But then, in September 2023, the Blumhouse folks stumbled across Fear the Spotlight. It was a moody, voxelized horror game about two friends sneaking around their haunted high school and communing with the ghosts of students that died in a fire in the '90s.