Large Language Model
Move over, Copilot! ChatGPT can now analyze OneDrive files in real time
In addition to gobbling up most of the internet, ChatGPT now wants access to your OneDrive and SharePoint files, too. One of the earliest uses of AI was to summarize documents and folders of documents, and there's only so many times you can ask it whether Spider-Man would beat Wonder Woman in a fair fight. It would be more productive for AI to collate and make sense of your own personal information, assuming you want to grant access to it. According to OpenAI, ChatGPT can now connect to your OneDrive or SharePoint document libraries, assuming you're a paid ChatGPT Plus, Pro, or Team user who lives outside the EEA, Switzerland, and the UK (via Windows Central). You'll obviously have to connect ChatGPT and give it permission to start poring over your cloud documents.
AI can spontaneously develop human-like communication, study finds
Artificial intelligence can spontaneously develop human-like social conventions, a study has found. The research, undertaken in collaboration between City St George's, University of London and the IT University of Copenhagen, suggests that when large language model (LLM) AI agents such as ChatGPT communicate in groups without outside involvement they can begin to adopt linguistic forms and social norms the same way that humans do when they socialise. The study's lead author, Ariel Flint Ashery, a doctoral researcher at City St George's, said the group's work went against the majority of research done into AI, as it treated AI as a social rather than solitary entity. "Most research so far has treated LLMs in isolation but real-world AI systems will increasingly involve many interacting agents," said Ashery. "We wanted to know: can these models coordinate their behaviour by forming conventions, the building blocks of a society? The answer is yes, and what they do together can't be reduced to what they do alone."
Google is testing an 'AI Mode' button in place of 'I'm Feeling Lucky'
Several users are now reporting that Google Search has swapped its classic "I'm Feeling Lucky" button for an "AI Mode" button instead. In some cases, the AI Mode button appears to the right of the search bar with the I'm Feeling Lucky button remaining in its usual spot. AI Mode is an experimental feature that offers an AI-generated search experience powered by Google's Gemini 2.0 language model. Google spokesperson Ashley Thompson told The Verge that the search engine's AI Mode is currently only visible to a limited number of users in Google's experimental Labs environment. It's unclear at this point when--or if--the redesign could become the new standard for Google Search.
Google DeepMind's new AI agent uses large language models to crack real-world problems
"You can see it as a sort of super coding agent," says Pushmeet Kohli, a vice president at Google DeepMind who leads its AI for Science teams. "It doesn't just propose a piece of code or an edit, it actually produces a result that maybe nobody was aware of." In particular, AlphaEvolve came up with a way to improve the software Google uses to allocate jobs to its many millions of servers around the world. Google DeepMind claims the company has been using this new software across all of its data centers for more than a year, freeing up 0.7% of Google's total computing resources. That might not sound like much, but at Google's scale it's huge.
SoftBank profit doubles as AI demand boosts chip sales and startups
SoftBank reported a 124% jump in quarterly profit on resilient AI demand that's supporting startup valuations and chip unit sales, a boost to its aggressive data center investment plans. The Tokyo-based company reported net income of 517.18 billion ( 3.5 billion) in its fiscal fourth quarter. It was helped by the Vision Fund, which swung to a profit of 26.1 billion mainly on a surge in the value of TikTok owner ByteDance and its strong international sales. The earnings come at a critical juncture for SoftBank as it plans to invest 30 billion in OpenAI while leading a 100 billion foray into building AI hardware in the United States. Maintaining a healthy cash flow and balance sheet is key to securing the billions of dollars needed at minimum cost.
LLMSR@XLLM25: Less is More: Enhancing Structured Multi-Agent Reasoning via Quality-Guided Distillation
Yuan, Jiahao, Sun, Xingzhe, Yu, Xing, Wang, Jingwen, Du, Dehui, Cui, Zhiqing, Di, Zixiang
The LLMSR@XLLM25 formulates a low-resource structural reasoning task that challenges LLMs to generate interpretable, step-by-step rationales with minimal labeled data. We present Less is More, the third-place winning approach in the LLMSR@XLLM25, which focuses on structured reasoning from only 24 labeled examples. Our approach leverages a multi-agent framework with reverse-prompt induction, retrieval-augmented reasoning synthesis via GPT-4o, and dual-stage reward-guided filtering to distill high-quality supervision across three subtasks: question parsing, CoT parsing, and step-level verification. All modules are fine-tuned from Meta-Llama-3-8B-Instruct under a unified LoRA+ setup. By combining structure validation with reward filtering across few-shot and zero-shot prompts, our pipeline consistently improves structure reasoning quality. These results underscore the value of controllable data distillation in enhancing structured inference under low-resource constraints. Our code is available at https://github.com/JhCircle/Less-is-More.
Multi-Modal Language Models as Text-to-Image Model Evaluators
Chen, Jiahui, Ross, Candace, Askari-Hemmat, Reyhane, Sinha, Koustuv, Hall, Melissa, Drozdzal, Michal, Romero-Soriano, Adriana
The steady improvements of text-to-image (T2I) generative models lead to slow deprecation of automatic evaluation benchmarks that rely on static datasets, motivating researchers to seek alternative ways to evaluate the T2I progress. In this paper, we explore the potential of multi-modal large language models (MLLMs) as evaluator agents that interact with a T2I model, with the objective of assessing prompt-generation consistency and image aesthetics. We present Multimodal Text-to-Image Eval (MT2IE), an evaluation framework that iteratively generates prompts for evaluation, scores generated images and matches T2I evaluation of existing benchmarks with a fraction of the prompts used in existing static benchmarks. Moreover, we show that MT2IE's prompt-generation consistency scores have higher correlation with human judgment than scores previously introduced in the literature. MT2IE generates prompts that are efficient at probing T2I model performance, producing the same relative T2I model rankings as existing benchmarks while using only 1/80th the number of prompts for evaluation.
Red Teaming the Mind of the Machine: A Systematic Evaluation of Prompt Injection and Jailbreak Vulnerabilities in LLMs
--Large Language Models (LLMs) are increasingly integrated into consumer and enterprise applications. Despite their capabilities, they remain susceptible to adversarial attacks such as prompt injection and jailbreaks that override alignment safeguards. This paper provides a systematic investigation of jailbreak strategies against various state-of-the-art LLMs. We categorize over 1,400 adversarial prompts, analyze their success against GPT -4, Claude 2, Mistral 7B, and Vicuna, and examine their generalizability and construction logic. We further propose layered mitigation strategies and recommend a hybrid red-teaming and sandboxing approach for robust LLM security.
Codifying Character Logic in Role-Playing
This paper introduces Codified Profiles for role-playing, a novel approach that represents character logic as structured, executable functions for behavioral decision-making. Each profile defines a set of functions parse_by_scene(scene) that outputs a list of logic-grounded assertions triggered_statements, using both explicit control structures (e.g., if-then-else) and condition checks like check_condition(scene, question), where each question is a semantically meaningful prompt about the scene (e.g., "Is the character in danger?") discriminated by the role-playing LLM as true, false, or unknown. This explicit representation offers three key advantages over traditional prompt-based profiles, which append character descriptions directly into text prompts: (1) Persistence, by enforcing complete and consistent execution of character logic, rather than relying on the model's implicit reasoning; (2) Updatability, through systematic inspection and revision of behavioral logic, which is difficult to track or debug in prompt-only approaches; (3) Controllable Randomness, by supporting stochastic behavior directly within the logic, enabling fine-grained variability that prompting alone struggles to achieve. To validate these advantages, we introduce a new benchmark constructed from 83 characters and 5,141 scenes curated from Fandom, using NLI-based scoring to compare character responses against ground-truth actions. Our experiments demonstrate the significant benefits of codified profiles in improving persistence, updatability, and behavioral diversity. Notably, by offloading a significant portion of reasoning to preprocessing, codified profiles enable even 1B-parameter models to perform high-quality role-playing, providing a scalable and efficient foundation for local deployment of role-play agents.
A Head to Predict and a Head to Question: Pre-trained Uncertainty Quantification Heads for Hallucination Detection in LLM Outputs
Shelmanov, Artem, Fadeeva, Ekaterina, Tsvigun, Akim, Tsvigun, Ivan, Xie, Zhuohan, Kiselev, Igor, Daheim, Nico, Zhang, Caiqi, Vazhentsev, Artem, Sachan, Mrinmaya, Nakov, Preslav, Baldwin, Timothy
Large Language Models (LLMs) have the tendency to hallucinate, i.e., to sporadically generate false or fabricated information. This presents a major challenge, as hallucinations often appear highly convincing and users generally lack the tools to detect them. Uncertainty quantification (UQ) provides a framework for assessing the reliability of model outputs, aiding in the identification of potential hallucinations. In this work, we introduce pre-trained UQ heads: supervised auxiliary modules for LLMs that substantially enhance their ability to capture uncertainty compared to unsupervised UQ methods. Their strong performance stems from the powerful Transformer architecture in their design and informative features derived from LLM attention maps. Experimental evaluation shows that these heads are highly robust and achieve state-of-the-art performance in claim-level hallucination detection across both in-domain and out-of-domain prompts. Moreover, these modules demonstrate strong generalization to languages they were not explicitly trained on. We pre-train a collection of UQ heads for popular LLM series, including Mistral, Llama, and Gemma 2. We publicly release both the code and the pre-trained heads.