Country
Weaver: Kronecker Product Approximations of Spatiotemporal Attention for Traffic Network Forecasting
Cheong, Christopher, Davis, Gary, Choi, Seongjin
Spatiotemporal forecasting on transportation networks is a complex task that requires understanding how traffic nodes interact within a dynamic, evolving system dictated by traffic flow dynamics and social behavioral patterns. The importance of transportation networks and ITS for modern mobility and commerce necessitates forecasting models that are not only accurate but also interpretable, efficient, and robust under structural or temporal perturbations. Recent approaches, particularly Transformer-based architectures, have improved predictive performance but often at the cost of high computational overhead and diminished architectural interpretability. In this work, we introduce Weaver, a novel attention-based model that applies Kronecker product approximations (KPA) to decompose the PN X PN spatiotemporal attention of O(P^2N^2) complexity into local P X P temporal and N X N spatial attention maps. This Kronecker attention map enables our Parallel-Kronecker Matrix-Vector product (P2-KMV) for efficient spatiotemporal message passing with O(P^2N + N^2P) complexity. To capture real-world traffic dynamics, we address the importance of negative edges in modeling traffic behavior by introducing Valence Attention using the continuous Tanimoto coefficient (CTC), which provides properties conducive to precise latent graph generation and training stability. To fully utilize the model's learning capacity, we introduce the Traffic Phase Dictionary for self-conditioning. Evaluations on PEMS-BAY and METR-LA show that Weaver achieves competitive performance across model categories while training more efficiently.
Mina: A Multilingual LLM-Powered Legal Assistant Agent for Bangladesh for Empowering Access to Justice
Wasi, Azmine Toushik, Faisal, Wahid, Islam, Mst Rafia
Bangladesh's low-income population faces major barriers to affordable legal advice due to complex legal language, procedural opacity, and high costs. Existing AI legal assistants lack Bengali-language support and jurisdiction-specific adaptation, limiting their effectiveness. To address this, we developed Mina, a multilingual LLM-based legal assistant tailored for the Bangladeshi context. It employs multilingual embeddings and a RAG-based chain-of-tools framework for retrieval, reasoning, translation, and document generation, delivering context-aware legal drafts, citations, and plain-language explanations via an interactive chat interface. Evaluated by law faculty from leading Bangladeshi universities across all stages of the 2022 and 2023 Bangladesh Bar Council Exams, Mina scored 75-80% in Preliminary MCQs, Written, and simulated Viva Voce exams, matching or surpassing average human performance and demonstrating clarity, contextual understanding, and sound legal reasoning. Even under a conservative upper bound, Mina operates at just 0.12-0.61% of typical legal consultation costs in Bangladesh, yielding a 99.4-99.9\% cost reduction relative to human-provided services. These results confirm its potential as a low-cost, multilingual AI assistant that automates key legal tasks and scales access to justice, offering a real-world case study on building domain-specific, low-resource systems and addressing challenges of multilingual adaptation, efficiency, and sustainable public-service AI deployment.
Towards Non-Stationary Time Series Forecasting with Temporal Stabilization and Frequency Differencing
Lu, Junkai, Chen, Peng, Guo, Chenjuan, Shu, Yang, Wang, Meng, Yang, Bin
Time series forecasting is critical for decision-making across dynamic domains such as energy, finance, transportation, and cloud computing. However, real-world time series often exhibit non-stationarity, including temporal distribution shifts and spectral variability, which pose significant challenges for long-term time series forecasting. In this paper, we propose DTAF, a dual-branch framework that addresses non-stationarity in both the temporal and frequency domains. For the temporal domain, the Temporal Stabilizing Fusion (TFS) module employs a non-stationary mix of experts (MOE) filter to disentangle and suppress temporal non-stationary patterns while preserving long-term dependencies. For the frequency domain, the Frequency Wave Modeling (FWM) module applies frequency differencing to dynamically highlight components with significant spectral shifts. By fusing the complementary outputs of TFS and FWM, DT AF generates robust forecasts that adapt to both temporal and frequency domain non-stationarity. Extensive experiments on real-world benchmarks demonstrate that DT AF outperforms state-of-the-art baselines, yielding significant improvements in forecasting accuracy under non-stationary conditions.
Counterfactual Explanation for Multivariate Time Series Forecasting with Exogenous Variables
Currently, machine learning is widely used across various domains, including time series data analysis. However, some machine learning models function as black boxes, making interpretability a critical concern. One approach to address this issue is counterfactual explanation (CE), which aims to provide insights into model predictions. This study focuses on the relatively underexplored problem of generating counterfactual explanations for time series forecasting. We propose a method for extracting CEs in time series forecasting using exogenous variables, which are frequently encountered in fields such as business and marketing. In addition, we present methods for analyzing the influence of each variable over an entire time series, generating CEs by altering only specific variables, and evaluating the quality of the resulting CEs. We validate the proposed method through theoretical analysis and empirical experiments, showcasing its accuracy and practical applicability. These contributions are expected to support real-world decision-making based on time series data analysis.
SlotVLA: Towards Modeling of Object-Relation Representations in Robotic Manipulation
Hanyu, Taisei, Chung, Nhat, Le, Huy, Nguyen, Toan, Ikebe, Yuki, Gunderman, Anthony, Minh, Duy Nguyen Ho, Vo, Khoa, Kieu, Tung, Yamazaki, Kashu, Rainwater, Chase, Nguyen, Anh, Le, Ngan
Inspired by how humans reason over discrete objects and their relationships, we explore whether compact object-centric and object-relation representations can form a foundation for multitask robotic manipulation. Most existing robotic multitask models rely on dense embeddings that entangle both object and background cues, raising concerns about both efficiency and interpretability. In contrast, we study object-relation-centric representations as a pathway to more structured, efficient, and explainable visuomotor control. Our contributions are two-fold. First, we introduce LIBERO+, a fine-grained benchmark dataset designed to enable and evaluate object-relation reasoning in robotic manipulation. Unlike prior datasets, LIBERO+ provides object-centric annotations that enrich demonstrations with box- and mask-level labels as well as instance-level temporal tracking, supporting compact and interpretable visuomotor representations. Second, we propose SlotVLA, a slot-attention-based framework that captures both objects and their relations for action decoding. It uses a slot-based visual tokenizer to maintain consistent temporal object representations, a relation-centric decoder to produce task-relevant embeddings, and an LLM-driven module that translates these embeddings into executable actions. Experiments on LIBERO+ demonstrate that object-centric slot and object-relation slot representations drastically reduce the number of required visual tokens, while providing competitive generalization. Together, LIBERO+ and SlotVLA provide a compact, interpretable, and effective foundation for advancing object-relation-centric robotic manipulation.
Adaptive Detection of Software Aging under Workload Shift
Silva, Rafael Jose Moura, Nascimento, Maria Gizele, Machida, Fumio, Andrade, Ermeson
Software aging is a phenomenon that affects long-running systems, leading to progressive performance degradation and increasing the risk of failures. T o mitigate this problem, this work proposes an adaptive approach based on machine learning for software aging detection in environments subject to dynamic workload conditions. W e evaluate and compare a static model with adaptive models that incorporate adaptive detectors, specifically the Drift Detection Method (DDM) and Adaptive Windowing (ADWIN), originally developed for concept drift scenarios and applied in this work to handle workload shifts. Experiments with simulated sudden, gradual, and recurring workload transitions show that static models suffer a notable performance drop when applied to unseen workload profiles, whereas the adaptive model with ADWIN maintains high accuracy, achieving an F1-Score above 0.93 in all analyzed scenarios.
Beyond Static Cutoffs: One-Shot Dynamic Thresholding for Diffusion Language Models
Masked diffusion language models (MDLMs) are becoming competitive with their autoregressive counterparts but typically decode with fixed steps and sequential unmasking. To accelerate decoding, recent work such as Fast-dLLM enables parallel decoding via a static global confidence threshold, yet we observe strong block- and step-wise confidence fluctuations and, within a dataset, near-identical confidence trajectories across inputs as measured by cosine similarity. Motivated by these observations, we introduce One-Shot Dynamic Thresholding (OSDT), which calibrates thresholds on a single sequence and applies them to subsequent inputs with negligible overhead. On GPQA, GSM8K, and HumanEval, OSDT attains superior accuracy-throughput trade-offs (+24% tokens/s on GSM8K at the best accuracy, +45% on GPQA with comparable accuracy, and +50% on HumanEval with a modest accuracy gap). Beyond these results, our findings suggest broader opportunities to leverage reusable task-level confidence signatures for more general-purpose algorithmic and systems innovations in diffusion decoding.
Heuristic Step Planning for Learning Dynamic Bipedal Locomotion: A Comparative Study of Model-Based and Model-Free Approaches
Suliman, William, Chaikovskaia, Ekaterina, Davydenko, Egor, Gorbachev, Roman
This work presents an extended framework for learning-based bipedal locomotion that incorporates a heuristic step-planning strategy guided by desired torso velocity tracking. The framework enables precise interaction between a humanoid robot and its environment, supporting tasks such as crossing gaps and accurately approaching target objects. Unlike approaches based on full or simplified dynamics, the proposed method avoids complex step planners and analytical models. Step planning is primarily driven by heuristic commands, while a Raibert-type controller modulates the foot placement length based on the error between desired and actual torso velocity. We compare our method with a model-based step-planning approach -- the Linear Inverted Pendulum Model (LIPM) controller. Experimental results demonstrate that our approach attains comparable or superior accuracy in maintaining target velocity (up to 80%), significantly greater robustness on uneven terrain (over 50% improvement), and improved energy efficiency. These results suggest that incorporating complex analytical, model-based components into the training architecture may be unnecessary for achieving stable and robust bipedal walking, even in unstructured environments.
LongCat-Flash-Omni Technical Report
Meituan LongCat Team, null, Wang, Bairui, Bayan, null, Xiao, Bin, Zhang, Bo, Rong, Bolin, Chen, Borun, Wan, Chang, Zhang, Chao, Huang, Chen, Chen, Chen, Chen, Chen, Yang, Chengxu, Yang, Chengzuo, Han, Cong, Peng, Dandan, Ruan, Delian, Xin, Detai, Wang, Disong, Yang, Dongchao, Liu, Fanfan, Chen, Fengjiao, Yang, Fengyu, Dong, Gan, Huang, Gang, Xu, Gang, Wan, Guanglu, Tan, Guoqiang, Yu, Guoqiao, Qiu, Haibo, Lu, Hao, Liu, Hongbo, Xiang, Hongyu, Wu, Jiaheng, Yang, Jian, Liu, Jiaxing, Huang, Jing, Wang, Jingang, Ding, Jinrui, Jiang, Juchao, Kuang, Jun, Wang, Jun, Mei, Junhui, Ding, Ke, Zhang, Kefeng, Chen, Lei, Shi, Liang, Qiao, Limeng, Zheng, Liming, Ma, Lin, Guo, Liuyang, Ma, Liya, Sun, Luying, Gao, Man, Zhu, Mengshen, Cao, Miao, Lin, Minliang, Xu, Nuo, Shi, Peng, Zhang, Qi, Fang, Qian, Wang, Qian, Yang, Qian, Wang, Quanxiu, Weng, Rongxiang, Guo, Rongxin, Liang, Ruoxuan, Yang, Senbin, Xu, Shanbo, Lei, Shanglin, Ye, Shengze, Chen, Shimin, Chen, Shuaiqi, Hu, Shujie, Li, Shuo, Yang, Siqi, Xu, Siyu, Ren, Siyu, Li, Song, Liu, Songxiang, Bai, Tianhao, Dai, Tianye, Hong, Wei, Wang, Wei, Zhao, Weixiao, Cao, Wengang, Zhu, Wenlong, He, Wenlong, Su, Xi, Nan, Xi, Zhao, Xiaohan, Wang, Xiaohao, Zhao, Xiaoyu, Wang, Xiaoyu, Li, Xiaoyu, Pan, Xin, Chen, Xin, Sun, Xiusong, Xiang, Xu, Xing, Xudong, Cao, Xuezhi, Cai, Xunliang, Yang, Yang, Tan, Yanli, Yao, Yao, Sun, Yerui, Chen, Yi, Lu, Yifan, Gong, Yin, Zhang, Yining, Chen, Yitian, Gan, Yiyang, Tang, Yuchen, Xie, Yuchen, Wang, Yueqian, Zheng, Yuewen, Zhang, Yufei, Zhong, Yufeng, Qian, Yulei, Peng, Yuqi, Li, Yuqian, Jiang, Yuwei, Hu, Zeyang, Zhang, Zheng, Tian, Zhengkun, Hong, Zhiqing, Zeng, Zhixiong, Mi, Zhuqi, Li, Ziran, Wang, Ziwen, Zhao, Ziyi, Zhuang, Ziyuan, Zhao, Zizhe
We introduce LongCat-Flash-Omni, a state-of-the-art open-source omni-modal model with 560 billion parameters, excelling at real-time audio-visual interaction. By adopting a curriculum-inspired progressive training strategy that transitions from simpler to increasingly complex modality sequence modeling tasks, LongCat-Flash-Omni attains comprehensive multimodal capabilities while maintaining strong unimodal capability. Building upon LongCat-Flash, which adopts a high-performance Shortcut-connected Mixture-of-Experts (MoE) architecture with zero-computation experts, LongCat-Flash-Omni integrates efficient multimodal perception and speech reconstruction modules. Despite its immense size of 560B parameters (with 27B activated), LongCat-Flash-Omni achieves low-latency real-time audio-visual interaction. For training infrastructure, we developed a modality-decoupled parallelism scheme specifically designed to manage the data and model heterogeneity inherent in large-scale multimodal training. This innovative approach demonstrates exceptional efficiency by sustaining over 90% of the throughput achieved by text-only training. Extensive evaluations show that LongCat-Flash-Omni achieves state-of-the-art performance on omni-modal benchmarks among open-source models. Furthermore, it delivers highly competitive results across a wide range of modality-specific tasks, including text, image, and video understanding, as well as audio understanding and generation. We provide a comprehensive overview of the model architecture design, training procedures, and data strategies, and open-source the model to foster future research and development in the community.
The Iceberg Index: Measuring Skills-centered Exposure in the AI Economy
Chopra, Ayush, Bhattacharya, Santanu, Salvador, DeAndrea, Paul, Ayan, Wright, Teddy, Garg, Aditi, Ahmad, Feroz, Schwarze, Alice C., Raskar, Ramesh, Balaprakash, Prasanna
Artificial Intelligence is reshaping America's \$9.4 trillion labor market, with cascading effects that extend far beyond visible technology sectors. When AI transforms quality control tasks in automotive plants, consequences spread through logistics networks, supply chains, and local service economies. Yet traditional workforce metrics cannot capture these ripple effects: they measure employment outcomes after disruption occurs, not where AI capabilities overlap with human skills before adoption crystallizes. Project Iceberg addresses this gap using Large Population Models to simulate the human-AI labor market, representing 151 million workers as autonomous agents executing over 32,000 skills and interacting with thousands of AI tools. It introduces the Iceberg Index, a skills-centered metric that measures the wage value of skills AI systems can perform within each occupation. The Index captures technical exposure, where AI can perform occupational tasks, not displacement outcomes or adoption timelines. Analysis shows that visible AI adoption concentrated in computing and technology (2.2% of wage value, approx \$211 billion) represents only the tip of the iceberg. Technical capability extends far below the surface through cognitive automation spanning administrative, financial, and professional services (11.7%, approx \$1.2 trillion). This exposure is fivefold larger and geographically distributed across all states rather than confined to coastal hubs. Traditional indicators such as GDP, income, and unemployment explain less than 5% of this skills-based variation, underscoring why new indices are needed to capture exposure in the AI economy. By simulating how these capabilities may spread under scenarios, Iceberg enables policymakers and business leaders to identify exposure hotspots, prioritize investments, and test interventions before committing billions to implementation