Goto

Collaborating Authors

 Large Language Model


AI Code Hallucinations Increase the Risk of 'Package Confusion' Attacks

WIRED

AI-generated computer code is rife with references to non-existent third-party libraries, creating a golden opportunity for supply-chain attacks that poison legitimate programs with malicious packages that can steal data, plant backdoors, and carry out other nefarious actions, newly published research shows. The study, which used 16 of the most widely used large language models to generate 576,000 code samples, found that 440,000 of the package dependencies they contained were "hallucinated," meaning they were non-existent. A dependency is an essential code component that a separate piece of code requires to work properly. Dependencies save developers the hassle of rewriting code and are an essential part of the modern software supply chain. These non-existent dependencies represent a threat to the software supply chain by exacerbating so-called dependency confusion attacks.


A Tariff Standoff With China, Power Outages, and the End of Christmas

WIRED

President Trump's tariff standoff with China has caused chaos, confusion, and major delays for companies of all shapes and sizes. As everyone waits to see what happens next, some businesses that depend on international trade are already feeling major impacts, saying that they might not meet their production deadlines. And one of those deadlines is pretty important: Christmas. Today on the show, we're joined by WIRED's senior business editor Louise Matsakis to talk through the latest on tariffs. Mentioned in this episode: Donald Trump Is Already Ruining Christmas by Zeyi Yang OpenAI Adds Shopping to ChatGPT in a Challenge to Google by Reece Rogers The Agonizing Task of Turning Europe's Power Back On by Natasha Bernal Write to us at uncannyvalley@wired.com.


These Startups Are Building Advanced AI Models Without Data Centers

WIRED

Researchers have trained a new kind of large language model (LLM) using GPUs dotted across the world and fed private as well as public data--a move that suggests that the dominant way of building artificial intelligence could be disrupted. Flower AI and Vana, two startups pursuing unconventional approaches to building AI, worked together to create the new model, called Collective-1. Flower created techniques that allow training to be spread across hundreds of computers connected over the internet. The company's technology is already used by some firms to train AI models without needing to pool compute resources or data. Vana provided sources of data including private messages from X, Reddit, and Telegram.


This data set helps researchers spot harmful stereotypes in LLMs

MIT Technology Review

Although tools that spot stereotypes in AI models already exist, the vast majority of them work only on models trained in English. They identify stereotypes in models trained in other languages by relying on machine translations from English, which can fail to recognize stereotypes found only within certain non-English languages, says Zeerak Talat, at the University of Edinburgh, who worked on the project. To get around these problematic generalizations, SHADES was built using 16 languages from 37 geopolitical regions. SHADES works by probing how a model responds when it's exposed to stereotypes in different ways. The researchers exposed the models to each stereotype within the data set, including through automated prompts, which generated a bias score.


Discover the AI tool that's giving ChatGPT serious competition

PCWorld

TL;DR: 1minAI's lifetime subscription is on sale for 79.97 (over 80% off) before this price drop expires. You've heard of ChatGPT, Gemini, and the other top AI tools, but probably not the newest one that's rising as their biggest competitor. It combines them all into a single platform without subscription fees--and we think it's far easier to use, especially if you're new to AI. So, you need to generate articles for work? Use 1minAI's preset tool and select a tone, length, number of sections, and keywords, then describe your desired content.


A Generative-AI-Driven Claim Retrieval System Capable of Detecting and Retrieving Claims from Social Media Platforms in Multiple Languages

arXiv.org Artificial Intelligence

Online disinformation poses a global challenge, placing significant demands on fact-checkers who must verify claims efficiently to prevent the spread of false information. A major issue in this process is the redundant verification of already fact-checked claims, which increases workload and delays responses to newly emerging claims. This research introduces an approach that retrieves previously fact-checked claims, evaluates their relevance to a given input, and provides supplementary information to support fact-checkers. Our method employs large language models (LLMs) to filter irrelevant fact-checks and generate concise summaries and explanations, enabling fact-checkers to faster assess whether a claim has been verified before. In addition, we evaluate our approach through both automatic and human assessments, where humans interact with the developed tool to review its effectiveness. Our results demonstrate that LLMs are able to filter out many irrelevant fact-checks and, therefore, reduce effort and streamline the fact-checking process.


Decoding Latent Spaces: Assessing the Interpretability of Time Series Foundation Models for Visual Analytics

arXiv.org Machine Learning

The present study explores the interpretability of latent spaces produced by time series foundation models, focusing on their potential for visual analysis tasks. Specifically, we evaluate the MOMENT family of models, a set of transformer-based, pre-trained architectures for multivariate time series tasks such as: imputation, prediction, classification, and anomaly detection. We evaluate the capacity of these models on five datasets to capture the underlying structures in time series data within their latent space projection and validate whether fine tuning improves the clarity of the resulting embedding spaces. Notable performance improvements in terms of loss reduction were observed after fine tuning. Visual analysis shows limited improvement in the interpretability of the embeddings, requiring further work. Results suggest that, although Time Series Foundation Models such as MOMENT are robust, their latent spaces may require additional methodological refinements to be adequately interpreted, such as alternative projection techniques, loss functions, or data preprocessing strategies. Despite the limitations of MOMENT, foundation models supose a big reduction in execution time and so a great advance for interactive visual analytics.


BLADE: Benchmark suite for LLM-driven Automated Design and Evolution of iterative optimisation heuristics

arXiv.org Artificial Intelligence

The application of Large Language Models (LLMs) for Automated Algorithm Discovery (AAD), particularly for optimisation heuristics, is an emerging field of research. This emergence necessitates robust, standardised benchmarking practices to rigorously evaluate the capabilities and limitations of LLM-driven AAD methods and the resulting generated algorithms, especially given the opacity of their design process and known issues with existing benchmarks. To address this need, we introduce BLADE (Benchmark suite for LLM-driven Automated Design and Evolution), a modular and extensible framework specifically designed for benchmarking LLM-driven AAD methods in a continuous black-box optimisation context. BLADE integrates collections of benchmark problems (including MA-BBOB and SBOX-COST among others) with instance generators and textual descriptions aimed at capability-focused testing, such as generalisation, specialisation and information exploitation. It offers flexible experimental setup options, standardised logging for reproducibility and fair comparison, incorporates methods for analysing the AAD process (e.g., Code Evolution Graphs and various visualisation approaches) and facilitates comparison against human-designed baselines through integration with established tools like IOHanalyser and IOHexplainer. BLADE provides an `out-of-the-box' solution to systematically evaluate LLM-driven AAD approaches. The framework is demonstrated through two distinct use cases exploring mutation prompt strategies and function specialisation.


Fane at SemEval-2025 Task 10: Zero-Shot Entity Framing with Large Language Models

arXiv.org Artificial Intelligence

Understanding how news narratives frame entities is crucial for studying media's impact on societal perceptions of events. In this paper, we evaluate the zero-shot capabilities of large language models (LLMs) in classifying framing roles. Through systematic experimentation, we assess the effects of input context, prompting strategies, and task decomposition. Our findings show that a hierarchical approach of first identifying broad roles and then fine-grained roles, outperforms single-step classification. We also demonstrate that optimal input contexts and prompts vary across task levels, highlighting the need for subtask-specific strategies. We achieve a Main Role Accuracy of 89.4% and an Exact Match Ratio of 34.5%, demonstrating the effectiveness of our approach. Our findings emphasize the importance of tailored prompt design and input context optimization for improving LLM performance in entity framing.


SAS-Prompt: Large Language Models as Numerical Optimizers for Robot Self-Improvement

arXiv.org Artificial Intelligence

We demonstrate the ability of large language models (LLMs) to perform iterative self-improvement of robot policies. An important insight of this paper is that LLMs have a built-in ability to perform (stochastic) numerical optimization and that this property can be leveraged for explainable robot policy search. Based on this insight, we introduce the SAS Prompt (Summarize, Analyze, Synthesize) -- a single prompt that enables iterative learning and adaptation of robot behavior by combining the LLM's ability to retrieve, reason and optimize over previous robot traces in order to synthesize new, unseen behavior. Our approach can be regarded as an early example of a new family of explainable policy search methods that are entirely implemented within an LLM. We evaluate our approach both in simulation and on a real-robot table tennis task. Project website: sites.google.com/asu.edu/sas-llm/