Education
SafeWork-R1: Coevolving Safety and Intelligence under the AI-45$^{\circ}$ Law
Lab, Shanghai AI, :, null, Bao, Yicheng, Chen, Guanxu, Chen, Mingkang, Chen, Yunhao, Chen, Chiyu, Chen, Lingjie, Chen, Sirui, Chen, Xinquan, Cheng, Jie, Cheng, Yu, Deng, Dengke, Ding, Yizhuo, Ding, Dan, Ding, Xiaoshan, Ding, Yi, Dong, Zhichen, Du, Lingxiao, Fan, Yuyu, Feng, Xinshun, Fu, Yanwei, Gao, Yuxuan, Ge, Ruijun, Gu, Tianle, Gui, Lujun, Guo, Jiaxuan, He, Qianxi, Hou, Yuenan, Hu, Xuhao, Huang, Hong, Huang, Kaichen, Huang, Shiyang, Jiang, Yuxian, Lei, Shanzhe, Li, Jie, Li, Lijun, Li, Hao, Li, Juncheng, Li, Xiangtian, Li, Yafu, Li, Lingyu, Li, Xueyan, Liang, Haotian, Liu, Dongrui, Liu, Qihua, Liu, Zhixuan, Liu, Bangwei, Liu, Huacan, Liu, Yuexiao, Liu, Zongkai, Lu, Chaochao, Lu, Yudong, Lu, Xiaoya, Lu, Zhenghao, Lv, Qitan, Ma, Caoyuan, Ma, Jiachen, Ma, Xiaoya, Ma, Zhongtian, Meng, Lingyu, Miao, Ziqi, Niu, Yazhe, Peng, Yuezhang, Pu, Yuan, Qi, Han, Qian, Chen, Qiao, Xingge, Qu, Jingjing, Qu, Jiashu, Qu, Wanying, Qu, Wenwen, Qu, Xiaoye, Ren, Qihan, Ren, Qingnan, Ren, Qingyu, Shao, Jing, Shao, Wenqi, Shao, Shuai, Shi, Dongxing, Song, Xin, Song, Xinhao, Teng, Yan, Tong, Xuan, Wang, Yingchun, Wang, Xuhong, Wang, Shujie, Wang, Xin, Wang, Yige, Wang, Yixu, Wang, Yuanfu, Wang, Futing, Wang, Ruofan, Wang, Wenjie, Wang, Yajie, Wei, Muhao, Wen, Xiaoyu, Weng, Fenghua, Wu, Yuqi, Xiong, Yingtong, Xu, Xingcheng, Yang, Chao, Yang, Yue, Yao, Yang, Ye, Yulei, Yin, Zhenyun, Yu, Yi, Zhang, Bo, Zhang, Qiaosheng, Zhang, Jinxuan, Zhang, Yexin, Zheng, Yinqiang, Zhou, Hefeng, Zhou, Zhanhui, Zhu, Pengyu, Zhu, Qingzi, Zhu, Yubo, Zhou, Bowen
We introduce SafeWork-R1, a cutting-edge multimodal reasoning model that demonstrates the coevolution of capabilities and safety. It is developed by our proposed SafeLadder framework, which incorporates large-scale, progressive, safety-oriented reinforcement learning post-training, supported by a suite of multi-principled verifiers. Unlike previous alignment methods such as RLHF that simply learn human preferences, SafeLadder enables SafeWork-R1 to develop intrinsic safety reasoning and self-reflection abilities, giving rise to safety `aha' moments. Notably, SafeWork-R1 achieves an average improvement of $46.54\%$ over its base model Qwen2.5-VL-72B on safety-related benchmarks without compromising general capabilities, and delivers state-of-the-art safety performance compared to leading proprietary models such as GPT-4.1 and Claude Opus 4. To further bolster its reliability, we implement two distinct inference-time intervention methods and a deliberative search mechanism, enforcing step-level verification. Finally, we further develop SafeWork-R1-InternVL3-78B, SafeWork-R1-DeepSeek-70B, and SafeWork-R1-Qwen2.5VL-7B. All resulting models demonstrate that safety and capability can co-evolve synergistically, highlighting the generalizability of our framework in building robust, reliable, and trustworthy general-purpose AI.
Sign Spotting Disambiguation using Large Language Models
Low, JianHe, Sincan, Ozge Mercanoglu, Bowden, Richard
Sign spotting, the task of identifying and localizing individual signs within continuous sign language video, plays a pivotal role in scaling dataset annotations and addressing the severe data scarcity issue in sign language translation. While automatic sign spotting holds great promise for enabling frame-level supervision at scale, it grapples with challenges such as vocabulary inflexibility and ambiguity inherent in continuous sign streams. Hence, we introduce a novel, training-free framework that integrates Large Language Models (LLMs) to significantly enhance sign spotting quality. Our approach extracts global spatio-temporal and hand shape features, which are then matched against a large-scale sign dictionary using dynamic time warping and cosine similarity. This dictionary-based matching inherently offers superior vocabulary flexibility without requiring model retraining. To mitigate noise and ambiguity from the matching process, an LLM performs context-aware gloss disambiguation via beam search, notably without fine-tuning. Extensive experiments on both synthetic and real-world sign language datasets demonstrate our method's superior accuracy and sentence fluency compared to traditional approaches, highlighting the potential of LLMs in advancing sign spotting.
McBE: A Multi-task Chinese Bias Evaluation Benchmark for Large Language Models
Lan, Tian, Su, Xiangdong, Liu, Xu, Wang, Ruirui, Chang, Ke, Li, Jiang, Gao, Guanglai
As large language models (LLMs) are increasingly applied to various NLP tasks, their inherent biases are gradually disclosed. Therefore, measuring biases in LLMs is crucial to mitigate its ethical risks. However, most existing bias evaluation datasets focus on English and North American culture, and their bias categories are not fully applicable to other cultures. The datasets grounded in the Chinese language and culture are scarce. More importantly, these datasets usually only support single evaluation tasks and cannot evaluate the bias from multiple aspects in LLMs. To address these issues, we present a Multi-task Chinese Bias Evaluation Benchmark (McBE) that includes 4,077 bias evaluation instances, covering 12 single bias categories, 82 subcategories and introducing 5 evaluation tasks, providing extensive category coverage, content diversity, and measuring comprehensiveness. Additionally, we evaluate several popular LLMs from different series and with parameter sizes. In general, all these LLMs demonstrated varying degrees of bias. We conduct an in-depth analysis of results, offering novel insights into bias in LLMs.
Multi-level Value Alignment in Agentic AI Systems: Survey and Perspectives
Zeng, Wei, Zhu, Hengshu, Qin, Chuan, Wu, Han, Cheng, Yihang, Zhang, Sirui, Jin, Xiaowei, Shen, Yinuo, Wang, Zhenxing, Zhong, Feimin, Xiong, Hui
The ongoing evolution of AI paradigms has propelled AI research into the agentic AI stage. Consequently, the focus of research has shifted from single agents and simple applications towards multi-agent autonomous decision-making and task collaboration in complex environments. As Large Language Models (LLMs) advance, their applications become more diverse and complex, leading to increasing situational and systemic risks. This has brought significant attention to value alignment for agentic AI systems, which aims to ensure that an agent's goals, preferences, and behaviors align with human values and societal norms. Addressing socio-governance demands through a Multi-level Value framework, this study comprehensively reviews value alignment in LLM-based multi-agent systems as the representative archetype of agentic AI systems. Our survey systematically examines three interconnected dimensions: First, value principles are structured via a top-down hierarchy across macro, meso, and micro levels. Second, application scenarios are categorized along a general-to-specific continuum explicitly mirroring these value tiers. Third, value alignment methods and evaluation are mapped to this tiered framework through systematic examination of benchmarking datasets and relevant methodologies. Additionally, we delve into value coordination among multiple agents within agentic AI systems. Finally, we propose several potential research directions in this field.
Evaluating LLM-Generated Q&A Test: a Student-Centered Study
Wrรณblewska, Anna, Grabek, Bartosz, ลwistak, Jakub, Dan, Daniel
This research prepares an automatic pipeline for generating reliable question-answer (Q&A) tests using AI chatbots. We automatically generated a GPT-4o-mini-based Q&A test for a Natural Language Processing course and evaluated its psychometric and perceived-quality metrics with students and experts. A mixed-format IRT analysis showed that the generated items exhibit strong discrimination and appropriate difficulty, while student and expert star ratings reflect high overall quality. A uniform DIF check identified two items for review. These findings demonstrate that LLM-generated assessments can match human-authored tests in psychometric performance and user satisfaction, illustrating a scalable approach to AI-assisted assessment development.
INTENTION: Inferring Tendencies of Humanoid Robot Motion Through Interactive Intuition and Grounded VLM
Wang, Jin, Wang, Weijie, Deng, Boyuan, Zhang, Heng, Dai, Rui, Tsagarakis, Nikos
Traditional control and planning for robotic manipulation heavily rely on precise physical models and predefined action sequences. While effective in structured environments, such approaches often fail in real-world scenarios due to modeling inaccuracies and struggle to generalize to novel tasks. In contrast, humans intuitively interact with their surroundings, demonstrating remarkable adaptability, making efficient decisions through implicit physical understanding. In this work, we propose INTENTION, a novel framework enabling robots with learned interactive intuition and autonomous manipulation in diverse scenarios, by integrating Vision-Language Models (VLMs) based scene reasoning with interaction-driven memory. We introduce Memory Graph to record scenes from previous task interactions which embodies human-like understanding and decision-making about different tasks in real world. Meanwhile, we design an Intuitive Perceptor that extracts physical relations and affordances from visual scenes. Together, these components empower robots to infer appropriate interaction behaviors in new scenes without relying on repetitive instructions. Videos: https://robo-intention.github.io
Hilbert Neural Operator: Operator Learning in the Analytic Signal Domain
Pordanesh, Saman, Shahsavari, Pejman, Ghadjari, Hossein
Neural operators have emerged as a powerful, data-driven paradigm for learning solution operators of partial differential equations (PDEs). State-of-the-art architectures, such as the Fourier Neural Operator (FNO), have achieved remarkable success by performing convolutions in the frequency domain, making them highly effective for a wide range of problems. However, this method has some limitations, including the periodicity assumption of the Fourier transform. In addition, there are other methods of analysing a signal, beyond phase and amplitude perspective, and provide us with other useful information to learn an effective network. We introduce the \textbf{Hilbert Neural Operator (HNO)}, a new neural operator architecture to address some advantages by incorporating a strong inductive bias from signal processing. HNO operates by first mapping the input signal to its analytic representation via the Hilbert transform, thereby making instantaneous amplitude and phase information explicit features for the learning process. The core learnable operation -- a spectral convolution -- is then applied to this Hilbert-transformed representation. We hypothesize that this architecture enables HNO to model operators more effectively for causal, phase-sensitive, and non-stationary systems. We formalize the HNO architecture and provide the theoretical motivation for its design, rooted in analytic signal theory.
Unified Flow Matching for Long Horizon Event Forecasting
Modeling long horizon marked event sequences is a fundamental challenge in many real-world applications, including healthcare, finance, and user behavior modeling. Existing neural temporal point process models are typically au-toregressive, predicting the next event one step at a time, which limits their efficiency and leads to error accumulation in long-range forecasting. In this work, we propose a unified flow matching framework for marked temporal point processes that enables non-autoregressive, joint modeling of inter-event times and event types, via continuous and discrete flow matching. By learning continuous-time flows for both components, our method generates coherent long horizon event trajectories without sequential decoding. We evaluate our model on six real-world benchmarks and demonstrate significant improvements over autoregressive and diffusion-based baselines in both accuracy and generation efficiency.
Evaluating the Impact of LLM-guided Reflection on Learning Outcomes with Interactive AI-Generated Educational Podcasts
Menon, Vishnu, Cherney, Andy, Cloude, Elizabeth B., Zhang, Li, Do, Tiffany D.
This study examined whether embedding LLM-guided reflection prompts in an interactive AI-generated podcast improved learning and user experience compared to a version without prompts. Thirty-six undergraduates participated, and while learning outcomes were similar across conditions, reflection prompts reduced perceived attractiveness, highlighting a call for more research on reflective interactivity design.
Agency, Affordances, and Enculturation of Augmentation Technologies
Duin, Ann Hill, Pedersen, Isabel
Augmentation technologies are undergoing a process of enculturation due to many factors, one being the rise of artificial intelligence (AI), or what the World Intellectual Property Organization (WIPO) terms the AI wave or AI boom. Chapter 3 focuses critical attention on the hyped assumption that sophisticated, emergent, and embodied augmentation technologies will improve lives, literacy, cultures, arts, economies, and social contexts. The chapter begins by discussing the problem of ambiguity with AI terminology, which it aids with a description of the WIPO Categorization of AI Technologies Scheme. It then draws on media and communication studies to explore concepts such as agents, agency, power, and agentive relationships between humans and robots. The chapter focuses on the development of non-human agents in industry as a critical factor in the rise of augmentation technologies. It looks at how marketing communication enculturates future users to adopt and adapt to the technology. Scholars are charting the significant ways that people are drawn further into commercial digital landscapes, such as the Metaverse concept, in post-internet society. It concludes by examining recent claims concerning the Metaverse and augmented reality.