Goto

Collaborating Authors

 Media


Addressing Topic Leakage in Cross-Topic Evaluation for Authorship Verification

arXiv.org Artificial Intelligence

Authorship verification (AV) aims to identify whether a pair of texts has the same author. We address the challenge of evaluating AV models' robustness against topic shifts. The conventional evaluation assumes minimal topic overlap between training and test data. However, we argue that there can still be topic leakage in test data, causing misleading model performance and unstable rankings. To address this, we propose an evaluation method called Heterogeneity-Informed Topic Sampling (HITS), which creates a smaller dataset with a heterogeneously distributed topic set. Our experimental results demonstrate that HITS-sampled datasets yield a more stable ranking of models across random seeds and evaluation splits. Our contributions include: 1. An analysis of causes and effects of topic leakage. 2. A demonstration of the HITS in reducing the effects of topic leakage, and 3. The Robust Authorship Verification bENchmark (RAVEN) that allows topic shortcut test to uncover AV models' reliance on topic-specific features.


From pixels to planning: scale-free active inference

arXiv.org Artificial Intelligence

This paper describes a discrete state-space model -- and accompanying methods -- for generative modelling. This model generalises partially observed Markov decision processes to include paths as latent variables, rendering it suitable for active inference and learning in a dynamic setting. Specifically, we consider deep or hierarchical forms using the renormalisation group. The ensuing renormalising generative models (RGM) can be regarded as discrete homologues of deep convolutional neural networks or continuous state-space models in generalised coordinates of motion. By construction, these scale-invariant models can be used to learn compositionality over space and time, furnishing models of paths or orbits; i.e., events of increasing temporal depth and itinerancy. This technical note illustrates the automatic discovery, learning and deployment of RGMs using a series of applications. We start with image classification and then consider the compression and generation of movies and music. Finally, we apply the same variational principles to the learning of Atari-like games.


Why Misinformation is Created? Detecting them by Integrating Intent Features

arXiv.org Artificial Intelligence

Various social media platforms, e.g., Twitter and Reddit, allow people to disseminate a plethora of information more efficiently and conveniently. However, they are inevitably full of misinformation, causing damage to diverse aspects of our daily lives. To reduce the negative impact, timely identification of misinformation, namely Misinformation Detection (MD), has become an active research topic receiving widespread attention. As a complex phenomenon, the veracity of an article is influenced by various aspects. In this paper, we are inspired by the opposition of intents between misinformation and real information. Accordingly, we propose to reason the intent of articles and form the corresponding intent features to promote the veracity discrimination of article features. To achieve this, we build a hierarchy of a set of intents for both misinformation and real information by referring to the existing psychological theories, and we apply it to reason the intent of articles by progressively generating binary answers with an encoder-decoder structure. We form the corresponding intent features and integrate it with the token features to achieve more discriminative article features for MD. Upon these ideas, we suggest a novel MD method, namely Detecting Misinformation by Integrating Intent featuRes (DM-INTER). To evaluate the performance of DM-INTER, we conduct extensive experiments on benchmark MD datasets. The experimental results validate that DM-INTER can outperform the existing baseline MD methods.


A Semi-supervised Fake News Detection using Sentiment Encoding and LSTM with Self-Attention

arXiv.org Artificial Intelligence

Micro-blogs and cyber-space social networks are the main communication mediums to receive and share news nowadays. As a side effect, however, the networks can disseminate fake news that harms individuals and the society. Several methods have been developed to detect fake news, but the majority require large sets of manually labeled data to attain the application-level accuracy. Due to the strict privacy policies, the required data are often inaccessible or limited to some specific topics. On the other side, quite diverse and abundant unlabeled data on social media suggests that with a few labeled data, the problem of detecting fake news could be tackled via semi-supervised learning. Here, we propose a semi-supervised self-learning method in which a sentiment analysis is acquired by some state-of-the-art pretrained models. Our learning model is trained in a semi-supervised fashion and incorporates LSTM with self-attention layers. We benchmark our model on a dataset with 20,000 news content along with their feedback, which shows better performance in precision, recall, and measures compared to competitive methods in fake news detection.


Exciting AI tools and games you can try for free

FOX News

WEHEAD connects to ChatGPT and displays a face, expressions and voice. My brain just does not work that way. I tried to learn Photoshop but gave up. Now, I create fun images using AI. Some AI tech is kind of freaky (like this brain-powered robot), but many of the new AI tools out there are just plain fun.


X's Grok AI is scanning your tweets. Here's how to disable it

PCWorld

Elon Musk, the divisive CEO of Tesla and more recently the owner of Twitter (now known as X), is a fierce critic of the AI industry--but now also a deeply invested participant in that very same industry. X's Grok generative AI product is being integrated into the web and mobile versions of the social network, and training itself on billions of tweets thanks to an automatic opt-in for all users. Well, it seems like a constantly refreshed pool of conversations from some of the web's most active users was simply too much for company xAI to resist, which now automatically scans your "posts as well as your interactions, inputs, and [Grok search] results." At the moment, X is using Grok as a chatbot for premium users and to replace human-made summaries of late-breaking news stories, with predictable issues resulting. The flippant and "rebellious" tone of the Grok model's responses has been criticized by initial users, and its reliance on constantly updated data from X seems to make it particularly susceptible to deliberate misinformation campaigns.


The Morning After: OpenAI reveals its AI-powered search engine, SearchGPT

Engadget

OpenAI announced a new AI-powered search engine prototype called SearchGPT. It's described SearchGPT as "a temporary prototype of new AI search features that give you fast and timely answers with clear and relevant sources." The company plans to test out the product with 10,000 initial users, then roll it into ChatGPT after gathering feedback. It's a spicy time to launch AI-powered search engines. Last month, Perplexity faced criticism for summarizing stories from Forbes and Wired without adequate attribution or backlinks to the publications.


AI concerns spur video game workers to go on strike starting Friday

FOX News

Video game performers with SAG-AFTRA will strike beginning Friday as AI "loopholes" have caused concerns. Beginning at 12:01 Friday morning, video game voice actors and motion capture performers under the Screen Actors Guild-American Federation of Television and Radio Artists will strike over artificial intelligence protections. This is the second strike for SAG-AFTRA performers in video games. While the union has conceded that wages and job safety have made gains in video game contracts, AI in interactive media continues to be a source of insecurity. TENS OF THOUSANDS OF GAMERS DESCEND ON LAS VEGAS FOR THE EVO TOURNAMENT SAG-AFTRA Chief Contracts Officer Ray Rodriguez shared at the presser on Thursday that some performers' work may be treated as "data" under current AI guidance.


Exploring Scaling Trends in LLM Robustness

arXiv.org Artificial Intelligence

Language model capabilities predictably improve from scaling a model's size and training data. Motivated by this, increasingly large language models have been trained, yielding an array of impressive capabilities. Yet these models are vulnerable to adversarial prompts, such as "jailbreaks" that hijack models to perform undesired behaviors, posing a significant risk of misuse. Prior work indicates that computer vision models become more robust with model and data scaling, raising the question: does language model robustness also improve with scale? We study this question empirically, finding that larger models respond substantially better to adversarial training, but there is little to no benefit from model scale in the absence of explicit defenses.


A Reliable Common-Sense Reasoning Socialbot Built Using LLMs and Goal-Directed ASP

arXiv.org Artificial Intelligence

The development of large language models (LLMs), such as GPT, has enabled the construction of several socialbots, like ChatGPT, that are receiving a lot of attention for their ability to simulate a human conversation. However, the conversation is not guided by a goal and is hard to control. In addition, because LLMs rely more on pattern recognition than deductive reasoning, they can give confusing answers and have difficulty integrating multiple topics into a cohesive response. These limitations often lead the LLM to deviate from the main topic to keep the conversation interesting. We propose AutoCompanion, a socialbot that uses an LLM model to translate natural language into predicates (and vice versa) and employs commonsense reasoning based on Answer Set Programming (ASP) to hold a social conversation with a human. In particular, we rely on s(CASP), a goal-directed implementation of ASP as the backend. This paper presents the framework design and how an LLM is used to parse user messages and generate a response from the s(CASP) engine output. To validate our proposal, we describe (real) conversations in which the chatbot's goal is to keep the user entertained by talking about movies and books, and s(CASP) ensures (i) correctness of answers, (ii) coherence (and precision) during the conversation, which it dynamically regulates to achieve its specific purpose, and (iii) no deviation from the main topic.