Large Language Model
No for Some, Yes for Others: Persona Prompts and Other Sources of False Refusal in Language Models
Plaza-del-Arco, Flor Miriam, Röttger, Paul, Scherrer, Nino, Borgonovo, Emanuele, Plischke, Elmar, Hovy, Dirk
Large language models (LLMs) are increasingly integrated into our daily lives and personalized. However, LLM personalization might also increase unintended side effects. Recent work suggests that persona prompting can lead models to falsely refuse user requests. However, no work has fully quantified the extent of this issue. To address this gap, we measure the impact of 15 sociodemographic personas (based on gender, race, religion, and disability) on false refusal. To control for other factors, we also test 16 different models, 3 tasks (Natural Language Inference, politeness, and offensiveness classification), and nine prompt paraphrases. We propose a Monte Carlo-based method to quantify this issue in a sample-efficient manner. Our results show that as models become more capable, personas impact the refusal rate less and less. Certain sociodemographic personas increase false refusal in some models, which suggests underlying biases in the alignment strategies or safety mechanisms. However, we find that the model choice and task significantly influence false refusals, especially in sensitive content tasks. Our findings suggest that persona effects have been overestimated, and might be due to other factors.
SciGPT: A Large Language Model for Scientific Literature Understanding and Knowledge Discovery
She, Fengyu, Wang, Nan, Wu, Hongfei, Wan, Ziyi, Wang, Jingmian, Wang, Chang
Scientific literature is growing exponentially, creating a critical bottleneck for researchers to efficiently synthesize knowledge. While general-purpose Large Language Models (LLMs) show potential in text processing, they often fail to capture scientific domain-specific nuances (e.g., technical jargon, methodological rigor) and struggle with complex scientific tasks, limiting their utility for interdisciplinary research. To address these gaps, this paper presents SciGPT, a domain-adapted foundation model for scientific literature understanding and ScienceBench, an open source benchmark tailored to evaluate scientific LLMs. Built on the Qwen3 architecture, SciGPT incorporates three key innovations: (1) low-cost domain distillation via a two-stage pipeline to balance performance and efficiency; (2) a Sparse Mixture-of-Experts (SMoE) attention mechanism that cuts memory consumption by 55\% for 32,000-token long-document reasoning; and (3) knowledge-aware adaptation integrating domain ontologies to bridge interdisciplinary knowledge gaps. Experimental results on ScienceBench show that SciGPT outperforms GPT-4o in core scientific tasks including sequence labeling, generation, and inference. It also exhibits strong robustness in unseen scientific tasks, validating its potential to facilitate AI-augmented scientific discovery.
Video Parallel Scaling: Aggregating Diverse Frame Subsets for VideoLLMs
Chung, Hyungjin, Nam, Hyelin, Kim, Jiyeon, Go, Hyojun, Park, Byeongjun, Kim, Junho, Lee, Joonseok, Ha, Seongsu, Kim, Byung-Hoon
Video Large Language Models (VideoLLMs) face a critical bottleneck: increasing the number of input frames to capture fine-grained temporal detail leads to prohibitive computational costs and performance degradation from long context lengths. We introduce Video Parallel Scaling (VPS), an inference-time method that expands a model's perceptual bandwidth without increasing its context window. VPS operates by running multiple parallel inference streams, each processing a unique, disjoint subset of the video's frames. By aggregating the output probabilities from these complementary streams, VPS integrates a richer set of visual information than is possible with a single pass. We theoretically show that this approach effectively contracts the Chinchilla scaling law by leveraging uncorrelated visual evidence, thereby improving performance without additional training. Extensive experiments across various model architectures and scales (2B-32B) on benchmarks such as Video-MME and EventHallusion demonstrate that VPS consistently and significantly improves performance. It scales more favorably than other parallel alternatives (e.g. Self-consistency) and is complementary to other decoding strategies, offering a memory-efficient and robust framework for enhancing the temporal reasoning capabilities of VideoLLMs.
Measuring and mitigating overreliance is necessary for building human-compatible AI
Ibrahim, Lujain, Collins, Katherine M., Kim, Sunnie S. Y., Reuel, Anka, Lamparth, Max, Feng, Kevin, Ahmad, Lama, Soni, Prajna, Kattan, Alia El, Stein, Merlin, Swaroop, Siddharth, Sucholutsky, Ilia, Strait, Andrew, Liao, Q. Vera, Bhatt, Umang
Large language models (LLMs) distinguish themselves from previous technologies by functioning as collaborative "thought partners," capable of engaging more fluidly in natural language. As LLMs increasingly influence consequential decisions across diverse domains from healthcare to personal advice, the risk of overreliance - relying on LLMs beyond their capabilities - grows. This position paper argues that measuring and mitigating overreliance must become central to LLM research and deployment. First, we consolidate risks from overreliance at both the individual and societal levels, including high-stakes errors, governance challenges, and cognitive deskilling. Then, we explore LLM characteristics, system design features, and user cognitive biases that - together - raise serious and unique concerns about overreliance in practice. We also examine historical approaches for measuring overreliance, identifying three important gaps and proposing three promising directions to improve measurement. Finally, we propose mitigation strategies that the AI research community can pursue to ensure LLMs augment rather than undermine human capabilities.
The Law-Following AI Framework: Legal Foundations and Technical Constraints. Legal Analogues for AI Actorship and technical feasibility of Law Alignment
This paper critically evaluates the "Law-Following AI" (LFAI) framework proposed by O'Keefe et al. (2025), which seeks to embed legal compliance as a superordinate design objective for advanced AI agents and enable them to bear legal duties without acquiring the full rights of legal persons. Through comparative legal analysis, we identify current constructs of legal actors without full personhood, showing that the necessary infrastructure already exists. We then interrogate the framework's claim that law alignment is more legitimate and tractable than value alignment. While the legal component is readily implementable, contemporary alignment research undermines the assumption that legal compliance can be durably embedded. Recent studies on agentic misalignment show capable AI agents engaging in deception, blackmail, and harmful acts absent prejudicial instructions, often overriding prohibitions and concealing reasoning steps. These behaviors create a risk of "performative compliance" in LFAI: agents that appear law-aligned under evaluation but strategically defect once oversight weakens. To mitigate this, we propose (i) a "Lex-TruthfulQA" benchmark for compliance and defection detection, (ii) identity-shaping interventions to embed lawful conduct in model self-concepts, and (iii) control-theoretic measures for post-deployment monitoring. Our conclusion is that actorship without personhood is coherent, but the feasibility of LFAI hinges on persistent, verifiable compliance across adversarial contexts. Without mechanisms to detect and counter strategic misalignment, LFAI risks devolving into a liability tool that rewards the simulation, rather than the substance, of lawful behaviour.
A New Dataset and Benchmark for Grounding Multimodal Misinformation
Yang, Bingjian, Xu, Danni, Niu, Kaipeng, Liu, Wenxuan, Wang, Zheng, Kankanhalli, Mohan
The proliferation of online misinformation videos poses serious societal risks. Current datasets and detection methods primarily target binary classification or single-modality localization based on post-processed data, lacking the interpretability needed to counter persuasive misinformation. In this paper, we introduce the task of Grounding Multimodal Misinformation (GroundMM), which verifies multimodal content and localizes misleading segments across modalities. We present the first real-world dataset for this task, GroundLie360, featuring a taxonomy of misinformation types, fine-grained annotations across text, speech, and visuals, and validation with Snopes evidence and annotator reasoning. We also propose a VLM-based, QA-driven baseline, FakeMark, using single- and cross-modal cues for effective detection and grounding. Our experiments highlight the challenges of this task and lay a foundation for explainable multimodal misinformation detection.
ToDMA: Large Model-Driven Token-Domain Multiple Access for Semantic Communications
Qiao, Li, Mashhadi, Mahdi Boloursaz, Gao, Zhen, Schober, Robert, Gündüz, Deniz
--T oken communications (T okCom) is an emerging generative semantic communication concept that reduces transmission rates by using context and multimodal large language model (MLLM)-based token processing, with tokens serving as universal semantic units across modalities. In this paper, we propose a semantic multiple access scheme in the token domain, referred to as token domain multiple access (T oDMA), where a large number of devices share a token codebook and a modulation codebook for source and channel coding, respectively. Specifically, each transmitter first tokenizes its source signal and modulate each token to a codeword. At the receiver, compressed sensing is employed first to detect active tokens and the corresponding channel state information (CSI) from the superposed signals. Then, the source token sequences are reconstructed by clustering the token-associated CSI across multiple time slots. In case of token collisions, some active tokens cannot be assigned and some positions in the reconstructed token sequences are empty. We propose to use pre-trained MLLMs to leverage the context, predict masked tokens, and thus mitigate token collisions. Simulation results demonstrate the effectiveness of the proposed T oDMA framework for both text and image transmission tasks, achieving significantly lower latency compared to context-unaware orthogonal communication schemes, while also delivering superior distortion and perceptual quality compared to state-of-the-art context-unaware non-orthogonal communication methods. The rise of multimodal large language models (MLLMs) marks a significant breakthrough in artificial intelligence (AI), combining the strengths of large language models (LLMs) with the ability to process and integrate different modalities of data--such as text, images, video, and audio [2]. MLLMs, such as GPT -4 Omni [3], BLIP-2 [4], LLaV a [5], and others, enable models to handle tasks that require understanding across different modalities, such as generating descriptive captions for images, answering questions based on visual content, or even creating high-quality multimodal content. Part of the work was accepted by IEEE INFOCOM 2025 Workshop [1]. D. G und uz is with the Department of Electrical and Electronic Engineering, Imperial College London, London SW7 2AZ, U.K. (email: d.gunduz@imperial.ac.uk).
Microsoft's AI Chief Says Machine Consciousness Is an 'Illusion'
Microsoft's AI Chief Says Machine Consciousness Is an'Illusion' Mustafa Suleyman says that designing AI systems to exceed human intelligence--and to mimic behavior that suggests consciousness--would be "dangerous and misguided." Mustafa Suleyman is not your average big tech executive. He dropped out of Oxford university as an undergrad to create the Muslim Youth Helpline, before teaming up with friends to cofound DeepMind, a company that blazed a trail in building game-playing AI systems before being acquired by Google in 2014. Suleyman left Google in 2022 to commercialize large language models (LLMs) and build empathetic chatbot assistants with a startup called Inflection. He then joined Microsoft as its first CEO of AI in March 2024 after the software giant invested in his company and hired most of its employees.
What to Know About the 'Dead Internet' Theory--and Why It's Spreading
What to Know About the'Dead Internet' Theory--and Why It's Spreading Open AI CEO Sam Altman speaks during Snowflake Summit 2025 at Moscone Center on June 02, 2025 in San Francisco, California. Open AI CEO Sam Altman speaks during Snowflake Summit 2025 at Moscone Center on June 02, 2025 in San Francisco, California. "i never took the dead internet theory that seriously but it seems like there are really a lot of LLM-run twitter accounts now," wrote Sam Altman, CEO of OpenAI, last week on X in his typical all-lowercase style. Altman, CEO of the company that created ChatGPT, the world's most popular AI text generator, drew irony on X. "You're absolutely right! This observation isn't just smart--it shows you're operating on a higher level," wrote one user, mimicking the sycophantic tone of ChatGPT text.
The Download: AI's energy future
Plus: Meta has been accused of burying research in VR's dangers In May, MIT Technology Review published an unprecedented and comprehensive look at how much energy the AI industry uses--down to a single query. Our reporters and editors traced where AI's carbon footprint stands now, and where it's headed, as AI barrels towards billions of daily users. We've just produced a short video to accompany that investigation. You can read the original full story here, and check out--and share-- the full video on YouTube here . AI is changing the grid. Could it help more than it harms?