Large Language Model
Will Humanity Be Rendered Obsolete by AI?
Louadi, Mohamed El, Romdhane, Emna Ben
This article analyzes the existential risks artificial intelligence (AI) poses to humanity, tracing the trajectory from current AI to ultraintelligence. Drawing on Irving J. Good and Nick Bostrom's theoretical work, plus recent publications (AI 2027; If Anyone Builds It, Everyone Dies), it explores AGI and superintelligence. Considering machines' exponentially growing cognitive power and hypothetical IQs, it addresses the ethical and existential implications of an intelligence vastly exceeding humanity's, fundamentally alien. Human extinction may result not from malice, but from uncontrollable, indifferent cognitive superiority.
Dialogue Is Not Enough to Make a Communicative BabyLM (But Neither Is Developmentally Inspired Reinforcement Learning)
Padovani, Francesca, Bunzeck, Bastian, Ali, Manar, Momen, Omar, Bisazza, Arianna, Buschmeier, Hendrik, Zarrieß, Sina
We investigate whether pre-training exclusively on dialogue data results in formally and functionally apt small language models. Based on this pre-trained llamalogue model, we employ a variety of fine-tuning strategies to enforce "more communicative" text generations by our models. Although our models underperform on most standard BabyLM benchmarks, they excel at dialogue continuation prediction in a minimal pair setting. While PPO fine-tuning has mixed to adversarial effects on our models, DPO fine-tuning further improves their performance on our custom dialogue benchmark.
Capturing Context-Aware Route Choice Semantics for Trajectory Representation Learning
Cao, Ji, Wang, Yu, Zheng, Tongya, Song, Jie, Guo, Qinghong, Ren, Zujie, Jin, Canghong, Chen, Gang, Song, Mingli
Abstract--Trajectory representation learning (TRL) aims to encode raw trajectory data into low-dimensional embeddings for downstream tasks such as travel time estimation, mobility prediction, and trajectory similarity analysis. From a behavioral perspective, a trajectory reflects a sequence of route choices within an urban environment. However, most existing TRL methods ignore this underlying decision-making process and instead treat trajectories as static, passive spatiotemporal sequences, thereby limiting the semantic richness of the learned representations. T o bridge this gap, we propose CORE, a TRL framework that integrates context-aware route choice semantics into trajectory embeddings. CORE first incorporates a multi-granular Environment Perception Module, which leverages large language models (LLMs) to distill environmental semantics from point of interest (POI) distributions, thereby constructing a context-enriched road network. Building upon this backbone, CORE employs a Route Choice Encoder with a mixture-of-experts (MoE) architecture, which captures route choice patterns by jointly leveraging the context-enriched road network and navigational factors. Extensive experiments on 4 real-world datasets across 6 downstream tasks demonstrate that CORE consistently outperforms 12 state-of-the-art TRL methods, achieving an average improvement of 9.79% over the best-performing baseline. Our code is available at https://github.com/caoji2001/CORE. Ji Cao, Y u Wang, Gang Chen, and Mingli Song are with the College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China; Ji Cao is also with the Zhejiang Lab, Hangzhou 311121, China (email: {caoj25, yu.wang, cg, brooksong}@zju.edu.cn). Tongya Zheng and Canghong Jin are with the Zhejiang Provincial Engineering Research Center for Real-Time SmartTech in Urban Security Governance, Hangzhou City University, Hangzhou 310015, China (e-mail: doujiang zheng@163.com; Jie Song is with the School of Software Technology, Zhejiang University, Ningbo 315100, China (e-mail: sjie@zju.edu.cn).
The Hidden DNA of LLM-Generated JavaScript: Structural Patterns Enable High-Accuracy Authorship Attribution
Tihanyi, Norbert, Cherif, Bilel, Dubniczky, Richard A., Ferrag, Mohamed Amine, Bisztray, Tamás
In this paper, we present the first large-scale study exploring whether JavaScript code generated by Large Language Models (LLMs) can reveal which model produced it, enabling reliable authorship attribution and model fingerprinting. With the rapid rise of AI-generated code, attribution is playing a critical role in detecting vulnerabilities, flagging malicious content, and ensuring accountability. While AI-vs-human detection usually treats AI as a single category we show that individual LLMs leave unique stylistic signatures, even among models belonging to the same family or parameter size. To this end, we introduce LLM-NodeJS, a dataset of 50,000 Node.js back-end programs from 20 large language models. Each has four transformed variants, yielding 250,000 unique JavaScript samples and two additional representations (JSIR and AST) for diverse research applications. Using this dataset, we benchmark traditional machine learning classifiers against fine-tuned Transformer encoders and introduce CodeT5-JSA, a custom architecture derived from the 770M-parameter CodeT5 model with its decoder removed and a modified classification head. It achieves 95.8% accuracy on five-class attribution, 94.6% on ten-class, and 88.5% on twenty-class tasks, surpassing other tested models such as BERT, CodeBERT, and Longformer. We demonstrate that classifiers capture deeper stylistic regularities in program dataflow and structure, rather than relying on surface-level features. As a result, attribution remains effective even after mangling, comment removal, and heavy code transformations. To support open science and reproducibility, we release the LLM-NodeJS dataset, Google Colab training scripts, and all related materials on GitHub: https://github.com/LLM-NodeJS-dataset.
NarraBench: A Comprehensive Framework for Narrative Benchmarking
Hamilton, Sil, Wilkens, Matthew, Piper, Andrew
We present NarraBench, a theory-informed taxonomy of narrative-understanding tasks, as well as an associated survey of 78 existing benchmarks in the area. We find significant need for new evaluations covering aspects of narrative understanding that are either overlooked in current work or are poorly aligned with existing metrics. Specifically, we estimate that only 27% of narrative tasks are well captured by existing benchmarks, and we note that some areas -- including narrative events, style, perspective, and revelation -- are nearly absent from current evaluations. We also note the need for increased development of benchmarks capable of assessing constitutively subjective and perspectival aspects of narrative, that is, aspects for which there is generally no single correct answer. Our taxonomy, survey, and methodology are of value to NLP researchers seeking to test LLM narrative understanding.
Get RICH or Die Scaling: Profitably Trading Inference Compute for Robustness
McDonald, Tavish, Lei, Bo, Fort, Stanislav, Kailkhura, Bhavya, Bartoldson, Brian
Models are susceptible to adversarially out-of-distribution (OOD) data despite large training-compute investments into their robustification. Zaremba et al. (2025) make progress on this problem at test time, showing LLM reasoning improves satisfaction of model specifications designed to thwart attacks, resulting in a correlation between reasoning effort and robustness to jailbreaks. However, this benefit of test compute fades when attackers are given access to gradients or multimodal inputs. We address this gap, clarifying that inference-compute offers benefits even in such cases. Our approach argues that compositional generalization, through which OOD data is understandable via its in-distribution (ID) components, enables adherence to defensive specifications on adversarially OOD inputs. Namely, we posit the Robustness from Inference Compute Hypothesis (RICH): inference-compute defenses profit as the model's training data better reflects the attacked data's components. We empirically support this hypothesis across vision language model and attack types, finding robustness gains from test-time compute if specification following on OOD data is unlocked by compositional generalization. For example, InternVL 3.5 gpt-oss 20B gains little robustness when its test compute is scaled, but such scaling adds significant robustness if we first robustify its vision encoder. This correlation of inference-compute's robustness benefit with base model robustness is the rich-get-richer dynamic of the RICH: attacked data components are more ID for robustified models, aiding compositional generalization to OOD data. Thus, we advise layering train-time and test-time defenses to obtain their synergistic benefit.
Influence Functions for Efficient Data Selection in Reasoning
Humane, Prateek, Cudrano, Paolo, Kaplan, Daniel Z., Matteucci, Matteo, Chakraborty, Supriyo, Rish, Irina
Fine-tuning large language models (LLMs) on chain-of-thought (CoT) data shows that a small amount of high-quality data can outperform massive datasets. Yet, what constitutes "quality" remains ill-defined. Existing reasoning methods rely on indirect heuristics such as problem difficulty or trace length, while instruction-tuning has explored a broader range of automated selection strategies, but rarely in the context of reasoning. We propose to define reasoning data quality using influence functions, which measure the causal effect of individual CoT examples on downstream accuracy, and introduce influence-based pruning, which consistently outperforms perplexity and embedding-based baselines on math reasoning within a model family.
SECA: Semantically Equivalent and Coherent Attacks for Eliciting LLM Hallucinations
Liang, Buyun, Peng, Liangzu, Luo, Jinqi, Thaker, Darshan, Chan, Kwan Ho Ryan, Vidal, René
Large Language Models (LLMs) are increasingly deployed in high-risk domains. However, state-of-the-art LLMs often produce hallucinations, raising serious concerns about their reliability. Prior work has explored adversarial attacks for hallucination elicitation in LLMs, but it often produces unrealistic prompts, either by inserting gibberish tokens or by altering the original meaning. As a result, these approaches offer limited insight into how hallucinations may occur in practice. While adversarial attacks in computer vision often involve realistic modifications to input images, the problem of finding realistic adversarial prompts for eliciting LLM hallucinations has remained largely underexplored. To address this gap, we propose Semantically Equivalent and Coherent Attacks (SECA) to elicit hallucinations via realistic modifications to the prompt that preserve its meaning while maintaining semantic coherence. Our contributions are threefold: (i) we formulate finding realistic attacks for hallucination elicitation as a constrained optimization problem over the input prompt space under semantic equivalence and coherence constraints; (ii) we introduce a constraint-preserving zeroth-order method to effectively search for adversarial yet feasible prompts; and (iii) we demonstrate through experiments on open-ended multiple-choice question answering tasks that SECA achieves higher attack success rates while incurring almost no semantic equivalence or semantic coherence errors compared to existing methods. SECA highlights the sensitivity of both open-source and commercial gradient-inaccessible LLMs to realistic and plausible prompt variations. Code is available at https://github.com/Buyun-Liang/SECA.
Beyond Token Length: Step Pruner for Efficient and Accurate Reasoning in Large Language Models
Wu, Canhui, Cao, Qiong, Li, Chang, Wang, Zhenfang, Xue, Chao, Fan, Yuwei, Xi, Wei, He, Xiaodong
Large Reasoning Models (LRMs) demonstrate strong performance on complex tasks but often suffer from excessive verbosity, known as "overthinking." Existing solutions via reinforcement learning (RL) typically penalize generated tokens to promote conciseness. However, these methods encounter two challenges: responses with fewer tokens do not always correspond to fewer reasoning steps, and models may develop hacking behavior in later stages of training by discarding reasoning steps to minimize token usage. In this work, we introduce \textbf{Step Pruner (SP)}, an RL framework that steers LRMs toward more efficient reasoning by favoring compact reasoning steps. Our step-aware reward function prioritizes correctness while imposing penalties for redundant steps, and withholds rewards for incorrect responses to prevent the reinforcement of erroneous reasoning. Moreover, we propose a dynamic stopping mechanism: when the model's output no longer shortens, training is halted to prevent hacking behavior caused by the merging of steps. Extensive experiments across four reasoning benchmarks demonstrate that SP achieves state-of-the-art accuracy while significantly reducing response length. For instance, on AIME24, SP reduces token usage by \textbf{69.7\%}.
Gemini Robotics 1.5: Pushing the Frontier of Generalist Robots with Advanced Embodied Reasoning, Thinking, and Motion Transfer
Gemini Robotics Team, null, Abdolmaleki, Abbas, Abeyruwan, Saminda, Ainslie, Joshua, Alayrac, Jean-Baptiste, Arenas, Montserrat Gonzalez, Balakrishna, Ashwin, Batchelor, Nathan, Bewley, Alex, Bingham, Jeff, Bloesch, Michael, Bousmalis, Konstantinos, Brakel, Philemon, Brohan, Anthony, Buschmann, Thomas, Byravan, Arunkumar, Cabi, Serkan, Caluwaerts, Ken, Casarini, Federico, Chan, Christine, Chang, Oscar, Chappellet-Volpini, London, Chen, Jose Enrique, Chen, Xi, Chiang, Hao-Tien Lewis, Choromanski, Krzysztof, Collister, Adrian, D'Ambrosio, David B., Dasari, Sudeep, Davchev, Todor, Dave, Meet Kirankumar, Devin, Coline, Di Palo, Norman, Ding, Tianli, Doersch, Carl, Dostmohamed, Adil, Du, Yilun, Dwibedi, Debidatta, Egambaram, Sathish Thoppay, Elabd, Michael, Erez, Tom, Fang, Xiaolin, Fantacci, Claudio, Fong, Cody, Frey, Erik, Fu, Chuyuan, Gao, Ruiqi, Giustina, Marissa, Gopalakrishnan, Keerthana, Graesser, Laura, Groth, Oliver, Gupta, Agrim, Hafner, Roland, Hansen, Steven, Hasenclever, Leonard, Haves, Sam, Heess, Nicolas, Hernaez, Brandon, Hofer, Alex, Hsu, Jasmine, Huang, Lu, Huang, Sandy H., Iscen, Atil, Jacob, Mithun George, Jain, Deepali, Jesmonth, Sally, Jindal, Abhishek, Julian, Ryan, Kalashnikov, Dmitry, Karagozler, M. Emre, Karp, Stefani, Kecman, Matija, Kew, J. Chase, Kim, Donnie, Kim, Frank, Kim, Junkyung, Kipf, Thomas, Kirmani, Sean, Konyushkova, Ksenia, Ku, Li Yang, Kuang, Yuheng, Lampe, Thomas, Laurens, Antoine, Le, Tuan Anh, Leal, Isabel, Lee, Alex X., Lee, Tsang-Wei Edward, Lever, Guy, Liang, Jacky, Lin, Li-Heng, Liu, Fangchen, Long, Shangbang, Lu, Caden, Maddineni, Sharath, Majumdar, Anirudha, Maninis, Kevis-Kokitsi, Marmon, Andrew, Martinez, Sergio, Michaely, Assaf Hurwitz, Milonopoulos, Niko, Moore, Joss, Moreno, Robert, Neunert, Michael, Nori, Francesco, Ortiz, Joy, Oslund, Kenneth, Parada, Carolina, Parisotto, Emilio, Paryag, Amaris, Pooley, Acorn, Power, Thomas, Quaglino, Alessio, Qureshi, Haroon, Raju, Rajkumar Vasudeva, Ran, Helen, Rao, Dushyant, Rao, Kanishka, Reid, Isaac, Rendleman, David, Reymann, Krista, Rivas, Miguel, Romano, Francesco, Rubanova, Yulia, Sampedro, Peter Pastor, Sanketi, Pannag R, Shah, Dhruv, Sharma, Mohit, Shea, Kathryn, Shridhar, Mohit, Shu, Charles, Sindhwani, Vikas, Singh, Sumeet, Soricut, Radu, Sterneck, Rachel, Storz, Ian, Surdulescu, Razvan, Tan, Jie, Tompson, Jonathan, Tunyasuvunakool, Saran, Varley, Jake, Vesom, Grace, Vezzani, Giulia, Villalonga, Maria Bauza, Vinyals, Oriol, Wagner, René, Wahid, Ayzaan, Welker, Stefan, Wohlhart, Paul, Wu, Chengda, Wulfmeier, Markus, Xia, Fei, Xiao, Ted, Xie, Annie, Xie, Jinyu, Xu, Peng, Xu, Sichun, Xu, Ying, Xu, Zhuo, Yan, Jimmy, Yang, Sherry, Yang, Skye, Yang, Yuxiang, Yu, Hiu Hong, Yu, Wenhao, Yuan, Wentao, Yuan, Yuan, Zhang, Jingwei, Zhang, Tingnan, Zhang, Zhiyuan, Zhou, Allan, Zhou, Guangyao, Zhou, Yuxiang
General-purpose robots need a deep understanding of the physical world, advanced reasoning, and general and dexterous control. This report introduces the latest generation of the Gemini Robotics model family: Gemini Robotics 1.5, a multi-embodiment Vision-Language-Action (VLA) model, and Gemini Robotics-ER 1.5, a state-of-the-art Embodied Reasoning (ER) model. We are bringing together three major innovations. First, Gemini Robotics 1.5 features a novel architecture and a Motion Transfer (MT) mechanism, which enables it to learn from heterogeneous, multi-embodiment robot data and makes the VLA more general. Second, Gemini Robotics 1.5 interleaves actions with a multi-level internal reasoning process in natural language. This enables the robot to "think before acting" and notably improves its ability to decompose and execute complex, multi-step tasks, and also makes the robot's behavior more interpretable to the user. Third, Gemini Robotics-ER 1.5 establishes a new state-of-the-art for embodied reasoning, i.e., for reasoning capabilities that are critical for robots, such as visual and spatial understanding, task planning, and progress estimation. Together, this family of models takes us a step towards an era of physical agents-enabling robots to perceive, think and then act so they can solve complex multi-step tasks.