Education
LongCat-Flash Technical Report
Meituan LongCat Team, null, Bayan, null, Li, Bei, Lei, Bingye, Wang, Bo, Rong, Bolin, Wang, Chao, Zhang, Chao, Gao, Chen, Zhang, Chen, Sun, Cheng, Han, Chengcheng, Xi, Chenguang, Zhang, Chi, Peng, Chong, Qin, Chuan, Zhang, Chuyu, Chen, Cong, Wang, Congkui, Ma, Dan, Pan, Daoru, Bu, Defei, Zhao, Dengchang, Kong, Deyang, Liu, Dishan, Huo, Feiye, Li, Fengcun, Zhang, Fubao, Dong, Gan, Liu, Gang, Xu, Gang, Li, Ge, Tan, Guoqiang, Lin, Guoyuan, Jing, Haihang, Fu, Haomin, Yan, Haonan, Wen, Haoxing, Zhao, Haozhe, Liu, Hong, Shi, Hongmei, Hao, Hongyan, Tang, Hongyin, Lv, Huantian, Su, Hui, Li, Jiacheng, Liu, Jiahao, Li, Jiahuan, Yang, Jiajun, Wang, Jiaming, Yang, Jian, Tan, Jianchao, Sun, Jiaqi, Zhang, Jiaqi, Fu, Jiawei, Yang, Jiawei, Hu, Jiaxi, Qin, Jiayu, Wang, Jingang, He, Jiyuan, Kuang, Jun, Mei, Junhui, Liang, Kai, He, Ke, Zhang, Kefeng, Wang, Keheng, He, Keqing, Gao, Liang, Shi, Liang, Ma, Lianhui, Qiu, Lin, Kong, Lingbin, Si, Lingtong, Lyu, Linkun, Guo, Linsen, Yang, Liqi, Yan, Lizhi, Xia, Mai, Gao, Man, Zhang, Manyuan, Zhou, Meng, Shen, Mengxia, Tuo, Mingxiang, Zhu, Mingyang, Li, Peiguang, Pei, Peng, Zhao, Peng, Jia, Pengcheng, Sun, Pingwei, Gu, Qi, Li, Qianyun, Li, Qingyuan, Huang, Qiong, Duan, Qiyuan, Meng, Ran, Weng, Rongxiang, Shao, Ruichen, Li, Rumei, Wu, Shizhe, Liang, Shuai, Wang, Shuo, Dang, Suogui, Fang, Tao, Li, Tao, Chen, Tefeng, Bai, Tianhao, Zhou, Tianhao, Xie, Tingwen, He, Wei, Huang, Wei, Liu, Wei, Shi, Wei, Wang, Wei, Wu, Wei, Zhao, Weikang, Zan, Wen, Shi, Wenjie, Nan, Xi, Su, Xi, Li, Xiang, Mei, Xiang, Ji, Xiangyang, Xi, Xiangyu, Huang, Xiangzhou, Li, Xianpeng, Fu, Xiao, Liu, Xiao, Wei, Xiao, Cai, Xiaodong, Chen, Xiaolong, Liu, Xiaoqing, Li, Xiaotong, Shi, Xiaowei, Li, Xiaoyu, Wang, Xili, Chen, Xin, Hu, Xing, Miao, Xingyu, He, Xinyan, Zhang, Xuemiao, Hao, Xueyuan, Cao, Xuezhi, Cai, Xunliang, Yang, Xurui, Feng, Yan, Bai, Yang, Chen, Yang, Yang, Yang, Huo, Yaqi, Sun, Yerui, Lu, Yifan, Zhang, Yifan, Zang, Yipeng, Zhai, Yitao, Li, Yiyang, Yin, Yongjing, Lv, Yongkang, Zhou, Yongwei, Yang, Yu, Xie, Yuchen, Sun, Yueqing, Zheng, Yuewen, Wei, Yuhuai, Qian, Yulei, Liang, Yunfan, Tai, Yunfang, Zhao, Yunke, Yu, Zeyang, Zhang, Zhao, Yang, Zhaohua, Zhang, Zhenchao, Xia, Zhikang, Zou, Zhiye, Zeng, Zhizhao, Su, Zhongda, Chen, Zhuofan, Zhang, Zijian, Wang, Ziwen, Jiang, Zixu, Zhao, Zizhe, Wang, Zongyu, Su, Zunhai
We introduce LongCat-Flash, a 560-billion-parameter Mixture-of-Experts (MoE) language model designed for both computational efficiency and advanced agentic capabilities. Stemming from the need for scalable efficiency, LongCat-Flash adopts two novel designs: (a) Zero-computation Experts, which enables dynamic computational budget allocation and activates 18.6B-31.3B (27B on average) per token depending on contextual demands, optimizing resource usage. (b) Shortcut-connected MoE, which enlarges the computation-communication overlap window, demonstrating notable gains in inference efficiency and throughput compared to models of a comparable scale. We develop a comprehensive scaling framework for large models that combines hyperparameter transfer, model-growth initialization, a multi-pronged stability suite, and deterministic computation to achieve stable and reproducible training. Notably, leveraging the synergy among scalable architectural design and infrastructure efforts, we complete model training on more than 20 trillion tokens within 30 days, while achieving over 100 tokens per second (TPS) for inference at a cost of \$0.70 per million output tokens. To cultivate LongCat-Flash towards agentic intelligence, we conduct a large-scale pre-training on optimized mixtures, followed by targeted mid- and post-training on reasoning, code, and instructions, with further augmentation from synthetic data and tool use tasks. Comprehensive evaluations demonstrate that, as a non-thinking foundation model, LongCat-Flash delivers highly competitive performance among other leading models, with exceptional strengths in agentic tasks. The model checkpoint of LongCat-Flash is open-sourced to foster community research. LongCat Chat: https://longcat.ai Hugging Face: https://huggingface.co/meituan-longcat GitHub: https://github.com/meituan-longcat
Beyond Linear Steering: Unified Multi-Attribute Control for Language Models
Oozeer, Narmeen, Marks, Luke, Barez, Fazl, Abdullah, Amirali
Controlling multiple behavioral attributes in large language models (LLMs) at inference time is a challenging problem due to interference between attributes and the limitations of linear steering methods, which assume additive behavior in activation space and require per-attribute tuning. We introduce K-Steering, a unified and flexible approach that trains a single non-linear multi-label classifier on hidden activations and computes intervention directions via gradients at inference time. This avoids linearity assumptions, removes the need for storing and tuning separate attribute vectors, and allows dynamic composition of behaviors without retraining. To evaluate our method, we propose two new benchmarks, ToneBank and DebateMix, targeting compositional behavioral control. Empirical results across 3 model families, validated by both activation-based classifiers and LLM-based judges, demonstrate that K-Steering outperforms strong baselines in accurately steering multiple behaviors.
SPaRC: A Spatial Pathfinding Reasoning Challenge
Kaesberg, Lars Benedikt, Wahle, Jan Philip, Ruas, Terry, Gipp, Bela
Existing reasoning datasets saturate and fail to test abstract, multi-step problems, especially pathfinding and complex rule constraint satisfaction. We introduce SPaRC (Spatial Pathfinding Reasoning Challenge), a dataset of 1,000 2D grid pathfinding puzzles to evaluate spatial and symbolic reasoning, requiring step-by-step planning with arithmetic and geometric rules. Humans achieve near-perfect accuracy (98.0%; 94.5% on hard puzzles), while the best reasoning models, such as o4-mini, struggle (15.8%; 1.1% on hard puzzles). Models often generate invalid paths (>50% of puzzles for o4-mini), and reasoning tokens reveal they make errors in navigation and spatial logic. Unlike humans, who take longer on hard puzzles, models fail to scale test-time compute with difficulty. Allowing models to make multiple solution attempts improves accuracy, suggesting potential for better spatial reasoning with improved training and efficient test-time scaling methods. SPaRC can be used as a window into models' spatial reasoning limitations and drive research toward new methods that excel in abstract, multi-step problem-solving.
Creative Preference Optimization
Ismayilzada, Mete, Laverghetta, Antonio Jr., Luchini, Simone A., Patel, Reet, Bosselut, Antoine, van der Plas, Lonneke, Beaty, Roger
While Large Language Models (LLMs) have demonstrated impressive performance across natural language generation tasks, their ability to generate truly creative content-characterized by novelty, diversity, surprise, and quality-remains limited. Existing methods for enhancing LLM creativity often focus narrowly on diversity or specific tasks, failing to address creativity's multifaceted nature in a generalizable way. In this work, we propose Creative Preference Optimization (CrPO), a novel alignment method that injects signals from multiple creativity dimensions into the preference optimization objective in a modular fashion. We train and evaluate creativity-augmented versions of several models using CrPO and MuCE, a new large-scale human preference dataset spanning over 200,000 human-generated responses and ratings from more than 30 psychological creativity assessments. Our models outperform strong baselines, including GPT-4o, on both automated and human evaluations, producing more novel, diverse, and surprising generations while maintaining high output quality. Additional evaluations on NoveltyBench further confirm the generalizability of our approach. Together, our results demonstrate that directly optimizing for creativity within preference frameworks is a promising direction for advancing the creative capabilities of LLMs without compromising output quality.
StreamBridge: Turning Your Offline Video Large Language Model into a Proactive Streaming Assistant
Wang, Haibo, Feng, Bo, Lai, Zhengfeng, Xu, Mingze, Li, Shiyu, Ge, Weifeng, Dehghan, Afshin, Cao, Meng, Huang, Ping
We present StreamBridge, a simple yet effective framework that seamlessly transforms offline Video-LLMs into streaming-capable models. It addresses two fundamental challenges in adapting existing models into online scenarios: (1) limited capability for multi-turn real-time understanding, and (2) lack of proactive response mechanisms. Specifically, StreamBridge incorporates (1) a memory buffer combined with a round-decayed compression strategy, supporting long-context multi-turn interactions, and (2) a decoupled, lightweight activation model that can be effortlessly integrated into existing Video-LLMs, enabling continuous proactive responses. To further support StreamBridge, we construct Stream-IT, a large-scale dataset tailored for streaming video understanding, featuring interleaved video-text sequences and diverse instruction formats. Extensive experiments show that StreamBridge significantly improves the streaming understanding capabilities of offline Video-LLMs across various tasks, outperforming even proprietary models such as GPT-4o and Gemini 1.5 Pro. Simultaneously, it achieves competitive or superior performance on standard video understanding benchmarks.
Tiny prairie dogs' poop play a mighty role in grasslands
Environment Conservation Land Tiny prairie dogs' poop play a mighty role in grasslands Breakthroughs, discoveries, and DIY tips sent every weekday. Earth is made of cycles. If you think back to high school Earth science class, you might remember the water cycle, the rock cycle, and the oxygen cycle, to name just a few. These natural processes continuously recycle our planet's materials, maintaining the environment that hosts life as we know it. The nutrient cycle is another crucial example of our planet's constant churn.
Say Hello to the 2025 Ig Nobel Prize Winners
The annual award ceremony features miniature operas, scientific demos, and 24/7 lectures. All products featured on WIRED are independently selected by our editors. However, we may receive compensation from retailers and/or from purchases of products through these links. Does alcohol enhance one's foreign language fluency? Do West African lizards have a preferred pizza topping? And can painting cows with zebra stripes help repel biting flies? These and other unusual research questions were honored tonight in a virtual ceremony to announce the 2025 recipients of the annual Ig Nobel Prizes.
The Landscape of Arabic Large Language Models
Membership in ACM includes a subscription to Communications of the ACM (CACM), the computing industry's most trusted source for staying connected to the world of advanced computing. The emergence of ChatGPT marked a transformative milestone for artificial intelligence (AI), showcasing the remarkable potential of large language models (LLMs) to generate human-like text. This wave of innovation has revolutionized how we interact with technology, seamlessly integrating LLMs into everyday tasks such as vacation planning, email drafting, and content creation. While English-speaking users have significantly benefited from these advancements, the Arabic world faces distinct challenges in developing Arabic-specific LLMs. Arabic, one of the languages spoken most widely around the world, serves more than 422 million native speakers in 27 countries and is deeply rooted in a rich linguistic and cultural heritage. Developing Arabic LLMs (ALLMs) presents an unparalleled opportunity to bridge technological gaps and empower communities. The journey of ALLMs has been both fascinating and complex, evolving from rudimentary text-processing systems to sophisticated AI-driven models. This article explores the trajectory of ALLMs, from their inception to the present day, highlighting the efforts to evaluate these models through benchmarks and public leaderboards.
The 2025 Ig Nobel Prizes honor garlicky babies, drunk bats, and more
The annual awards celebrate achievements that make us'laugh then think.' Breakthroughs, discoveries, and DIY tips sent every weekday. In the weeks before the Nobel Prizes are announced, the scientific community gathers every year for something a little more lighthearted: The Ig Nobel Prizes. Awarded to "honor achievements so surprising that they make people LAUGH, then THINK," this year marks the 35th anniversary of the awards. These prestigious awards celebrate science's more unusual contributions, honor the imaginative, and perhaps most importantly, spur people's interest in science, medicine, and technology . This year's honorees brought us pizza-eating lizards, tipsy bats, nail growth, and more that all celebrate the joy and fun in asking any and all questions.
Stochastic Adaptive Gradient Descent Without Descent
Aujol, Jean-François, Bigot, Jérémie, Castera, Camille
We introduce a new adaptive step-size strategy for convex optimization with stochastic gradient that exploits the local geometry of the objective function only by means of a first-order stochastic oracle and without any hyper-parameter tuning. The method comes from a theoretically-grounded adaptation of the Adaptive Gradient Descent Without Descent method to the stochastic setting. We prove the convergence of stochastic gradient descent with our step-size under various assumptions, and we show that it empirically competes against tuned baselines.