Large Language Model
Finding your MUSE: Mining Unexpected Solutions Engine
Sweed, Nir, Hakim, Hanit, Wolfson, Ben, Lifshitz, Hila, Shahaf, Dafna
Innovators often exhibit cognitive fixation on existing solutions or nascent ideas, hindering the exploration of novel alternatives. This paper introduces a methodology for constructing Functional Concept Graphs (FCGs), interconnected representations of functional elements that support abstraction, problem reframing, and analogical inspiration. Our approach yields large-scale, high-quality FCGs with explicit abstraction relations, overcoming limitations of prior work. We further present MUSE, an algorithm leveraging FCGs to generate creative inspirations for a given problem. We demonstrate our method by computing an FCG on 500K patents, which we release for further research.
Pointing-Guided Target Estimation via Transformer-Based Attention
Mรผller, Luca, Ali, Hassan, Allgeuer, Philipp, Gajdoลกech, Lukรกลก, Wermter, Stefan
Deictic gestures, like pointing, are a fundamental form of non-verbal communication, enabling humans to direct attention to specific objects or locations. This capability is essential in Human-Robot Interaction (HRI), where robots should be able to predict human intent and anticipate appropriate responses. In this work, we propose the Multi-Modality Inter-TransFormer (MM-ITF), a modular architecture to predict objects in a controlled tabletop scenario with the NICOL robot, where humans indicate targets through natural pointing gestures. Leveraging inter-modality attention, MM-ITF maps 2D pointing gestures to object locations, assigns a likelihood score to each, and identifies the most likely target. Our results demonstrate that the method can accurately predict the intended object using monocular RGB data, thus enabling intuitive and accessible human-robot collaboration. To evaluate the performance, we introduce a patch confusion matrix, providing insights into the model's predictions across candidate object locations. Code available at: https://github.com/lucamuellercode/MMITF.
FLOWER: Democratizing Generalist Robot Policies with Efficient Vision-Language-Action Flow Policies
Reuss, Moritz, Zhou, Hongyi, Rรผhle, Marcel, Yaฤmurlu, รmer Erdinรง, Otto, Fabian, Lioutikov, Rudolf
Developing efficient Vision-Language-Action (VLA) policies is crucial for practical robotics deployment, yet current approaches face prohibitive computational costs and resource requirements. Existing diffusion-based VLA policies require multi-billion-parameter models and massive datasets to achieve strong performance. We tackle this efficiency challenge with two contributions: intermediate-modality fusion, which reallocates capacity to the diffusion head by pruning up to $50\%$ of LLM layers, and action-specific Global-AdaLN conditioning, which cuts parameters by $20\%$ through modular adaptation. We integrate these advances into a novel 950 M-parameter VLA called FLOWER. Pretrained in just 200 H100 GPU hours, FLOWER delivers competitive performance with bigger VLAs across $190$ tasks spanning ten simulation and real-world benchmarks and demonstrates robustness across diverse robotic embodiments. In addition, FLOWER achieves a new SoTA of 4.53 on the CALVIN ABC benchmark. Demos, code and pretrained weights are available at https://intuitive-robots.github.io/flower_vla/.
CEHR-XGPT: A Scalable Multi-Task Foundation Model for Electronic Health Records
Pang, Chao, Park, Jiheum, Jiang, Xinzhuo, Pavinkurve, Nishanth Parameshwar, Kalluri, Krishna S., Joshi, Shalmali, Elhadad, Noรฉmie, Natarajan, Karthik
Electronic Health Records (EHRs) provide a rich, longitudinal view of patient health and hold significant potential for advancing clinical decision support, risk prediction, and data-driven healthcare research. However, most artificial intelligence (AI) models for EHRs are designed for narrow, single-purpose tasks, limiting their generalizability and utility in real-world settings. Here, we present CEHR-XGPT, a general-purpose foundation model for EHR data that unifies three essential capabilities - feature representation, zero-shot prediction, and synthetic data generation - within a single architecture. To support temporal reasoning over clinical sequences, CEHR-XGPT incorporates a novel time-token-based learning framework that explicitly encodes patients' dynamic timelines into the model structure. CEHR-XGPT demonstrates strong performance across all three tasks and generalizes effectively to external datasets through vocabulary expansion and fine-tuning. Its versatility enables rapid model development, cohort discovery, and patient outcome forecasting without the need for task-specific retraining.
UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning
Wang, Haoming, Zou, Haoyang, Song, Huatong, Feng, Jiazhan, Fang, Junjie, Lu, Junting, Liu, Longxiang, Luo, Qinyu, Liang, Shihao, Huang, Shijue, Zhong, Wanjun, Ye, Yining, Qin, Yujia, Xiong, Yuwen, Song, Yuxin, Wu, Zhiyong, Li, Aoyan, Li, Bo, Dun, Chen, Liu, Chong, Zan, Daoguang, Leng, Fuxing, Wang, Hanbin, Yu, Hao, Chen, Haobin, Guo, Hongyi, Su, Jing, Huang, Jingjia, Shen, Kai, Shi, Kaiyu, Yan, Lin, Zhao, Peiyao, Liu, Pengfei, Ye, Qinghao, Zheng, Renjie, Xin, Shulin, Zhao, Wayne Xin, Heng, Wen, Huang, Wenhao, Wang, Wenqian, Qin, Xiaobo, Lin, Yi, Wu, Youbin, Chen, Zehui, Wang, Zihao, Zhong, Baoquan, Zhang, Xinchun, Li, Xujing, Li, Yuanfan, Zhao, Zhongkai, Jiang, Chengquan, Wu, Faming, Zhou, Haotian, Pang, Jinlin, Han, Li, Liu, Qi, Ma, Qianli, Liu, Siyao, Cai, Songhua, Fu, Wenqi, Liu, Xin, Wang, Yaohui, Zhang, Zhi, Zhou, Bo, Li, Guoliang, Shi, Jiajun, Yang, Jiale, Tang, Jie, Li, Li, Han, Qihua, Lu, Taoran, Lin, Woyu, Tong, Xiaokang, Li, Xinyao, Zhang, Yichi, Miao, Yu, Jiang, Zhengxuan, Li, Zili, Zhao, Ziyuan, Li, Chenxin, Ma, Dehua, Lin, Feng, Zhang, Ge, Yang, Haihua, Guo, Hangyu, Zhu, Hongda, Liu, Jiaheng, Du, Junda, Cai, Kai, Li, Kuanye, Yuan, Lichen, Han, Meilan, Wang, Minchao, Guo, Shuyue, Cheng, Tianhao, Ma, Xiaobo, Xiao, Xiaojun, Huang, Xiaolong, Chen, Xinjie, Du, Yidi, Chen, Yilin, Wang, Yiwen, Li, Zhaojian, Yang, Zhenzhu, Zeng, Zhiyuan, Jin, Chaolin, Li, Chen, Chen, Hao, Chen, Haoli, Chen, Jian, Zhao, Qinghao, Shi, Guang
The development of autonomous agents for graphical user interfaces (GUIs) presents major challenges in artificial intelligence. While recent advances in native agent models have shown promise by unifying perception, reasoning, action, and memory through end-to-end learning, open problems remain in data scalability, multi-turn reinforcement learning (RL), the limitations of GUI-only operation, and environment stability. In this technical report, we present UI-TARS-2, a native GUI-centered agent model that addresses these challenges through a systematic training methodology: a data flywheel for scalable data generation, a stabilized multi-turn RL framework, a hybrid GUI environment that integrates file systems and terminals, and a unified sandbox platform for large-scale rollouts. Empirical evaluation demonstrates that UI-TARS-2 achieves significant improvements over its predecessor UI-TARS-1.5. On GUI benchmarks, it reaches 88.2 on Online-Mind2Web, 47.5 on OSWorld, 50.6 on WindowsAgentArena, and 73.3 on AndroidWorld, outperforming strong baselines such as Claude and OpenAI agents. In game environments, it attains a mean normalized score of 59.8 across a 15-game suite-roughly 60% of human-level performance-and remains competitive with frontier proprietary models (e.g., OpenAI o3) on LMGame-Bench. Additionally, the model can generalize to long-horizon information-seeking tasks and software engineering benchmarks, highlighting its robustness across diverse agent tasks. Detailed analyses of training dynamics further provide insights into achieving stability and efficiency in large-scale agent RL. These results underscore UI-TARS-2's potential to advance the state of GUI agents and exhibit strong generalization to real-world interactive scenarios.
PiCSAR: Probabilistic Confidence Selection And Ranking for Reasoning Chains
Leang, Joshua Ong Jun, Zhao, Zheng, Gema, Aryo Pradipta, Yang, Sohee, Kwan, Wai-Chung, He, Xuanli, Li, Wenda, Minervini, Pasquale, Giunchiglia, Eleonora, Cohen, Shay B.
Best-of-n sampling improves the accuracy of large language models (LLMs) and large reasoning models (LRMs) by generating multiple candidate solutions and selecting the one with the highest reward. The key challenge for reasoning tasks is designing a scoring function that can identify correct reasoning chains without access to ground-truth answers. We propose Probabilistic Confidence Selection And Ranking (PiCSAR): a simple, training-free method that scores each candidate generation using the joint log-likelihood of the reasoning and final answer. The joint log-likelihood of the reasoning and final answer naturally decomposes into reasoning confidence and answer confidence. PiCSAR achieves substantial gains across diverse benchmarks (+10.18 on MATH500, +9.81 on AIME2025), outperforming baselines with at least 2x fewer samples in 16 out of 20 comparisons. Our analysis reveals that correct reasoning chains exhibit significantly higher reasoning and answer confidence, justifying the effectiveness of PiCSAR.
Social Bias in Multilingual Language Models: A Survey
Gamboa, Lance Calvin Lim, Feng, Yue, Lee, Mark
Pretrained multilingual models exhibit the same social bias as models processing English texts. This systematic review analyzes emerging research that extends bias evaluation and mitigation approaches into multilingual and non-English contexts. We examine these studies with respect to linguistic diversity, cultural awareness, and their choice of evaluation metrics and mitigation techniques. Our survey illuminates gaps in the field's dominant methodological design choices (e.g., preference for certain languages, scarcity of multilingual mitigation experiments) while cataloging common issues encountered and solutions implemented in adapting bias benchmarks across languages and cultures. Drawing from the implications of our findings, we chart directions for future research that can reinforce the multilingual bias literature's inclusivity, cross-cultural appropriateness, and alignment with state-of-the-art NLP advancements.
Mitigating Hallucinations in LM-Based TTS Models via Distribution Alignment Using GFlowNets
Liu, Chenlin, Fang, Minghui, Zhang, Patrick, Zhou, Wei, Gao, Jie, Han, Jiqing
Language Model (LM)-based Text-to-Speech (TTS) systems often generate hallucinated speech that deviates from input text. Existing mitigation strategies either demand excessive training resources or introduce significant inference latency. In this paper, we propose GFlOwNet-guided distribution AlignmenT (GOAT) for LM-based TTS, a post-training framework that mitigates hallucinations without relying on massive resources or inference cost. Specifically, we first conduct an uncertainty analysis, revealing a strong positive correlation between hallucination and model uncertainty. Based on this, we reformulate TTS generation as a trajectory flow optimization problem and introduce an enhanced Subtrajectory Balance objective together with a sharpened internal reward as target distribution. We further integrate reward temperature decay and learning rate optimization for stability and performance balance. Extensive experiments show that GOAT reduce over 50% character error rates on challenging test cases and lowering uncertainty by up to 58%, demonstrating its strong generalization ability and effectiveness.
Conversational Education at Scale: A Multi-LLM Agent Workflow for Procedural Learning and Pedagogic Quality Assessment
Pei, Jiahuan, Ye, Fanghua, Sun, Xin, Deng, Wentao, Hindriks, Koen, Wang, Junxiao
Large language models (LLMs) have advanced virtual educators and learners, bridging NLP with AI4Education. Existing work often lacks scalability and fails to leverage diverse, large-scale course content, with limited frameworks for assessing pedagogic quality. To this end, we propose WikiHowAgent, a multi-agent workflow leveraging LLMs to simulate interactive teaching-learning conversations. It integrates teacher and learner agents, an interaction manager, and an evaluator to facilitate procedural learning and assess pedagogic quality. We introduce a dataset of 114,296 teacher-learner conversations grounded in 14,287 tutorials across 17 domains and 727 topics. Our evaluation protocol combines computational and rubric-based metrics with human judgment alignment. Results demonstrate the workflow's effectiveness in diverse setups, offering insights into LLM capabilities across domains. Our datasets and implementations are fully open-sourced.
DiMo-GUI: Advancing Test-time Scaling in GUI Grounding via Modality-Aware Visual Reasoning
Wu, Hang, Chen, Hongkai, Cai, Yujun, Liu, Chang, Ye, Qingwen, Yang, Ming-Hsuan, Wang, Yiwei
Grounding natural language queries in graphical user interfaces (GUIs) poses unique challenges due to the diversity of visual elements, spatial clutter, and the ambiguity of language. In this paper, we introduce DiMo-GUI, a training-free framework for GUI grounding that leverages two core strategies: dynamic visual grounding and modality-aware optimization. Instead of treating the GUI as a monolithic image, our method splits the input into textual elements and iconic elements, allowing the model to reason over each modality independently using general-purpose vision-language models. When predictions are ambiguous or incorrect, DiMo-GUI dynamically focuses attention by generating candidate focal regions centered on the model's initial predictions and incrementally zooms into subregions to refine the grounding result. This hierarchical refinement process helps disambiguate visually crowded layouts without the need for additional training or annotations. We evaluate our approach on standard GUI grounding benchmarks and demonstrate consistent improvements over baseline inference pipelines, highlighting the effectiveness of combining modality separation with region-focused reasoning.