Industry
S2ML: Spatio-Spectral Mutual Learning for Depth Completion
Zhao, Zihui, Zhang, Yifei, Wang, Zheng, Li, Yang, Jiang, Kui, Geng, Zihan, Lin, Chia-Wen
Abstract--The raw depth images captured by RGB-D cameras using Time-of-Flight (TOF) or structured light often suffer from incomplete depth values due to weak reflections, boundary shadows, and artifacts, which limit their applications in downstream vision tasks. Existing methods address this problem through depth completion in the image domain, but they overlook the physical characteristics of raw depth images. It has been observed that the presence of invalid depth areas alters the frequency distribution pattern. In this work, we propose a Spatio-Spectral Mutual Learning framework (S2ML) to harmonize the advantages of both spatial and frequency domains for depth completion. Specifically, we consider the distinct properties of amplitude and phase spectra and devise a dedicated spectral fusion module. Meanwhile, the local and global correlations between spatial-domain and frequency-domain features are calculated in a unified embedding space. The gradual mutual representation and refinement encourage the network to fully explore complementary physical characteristics and priors for more accurate depth completion. Extensive experiments demonstrate the effectiveness of our proposed S2ML method, outperforming the state-of-the-art method CFormer by 0.828 dB and 0.834 dB on the NYU-Depth V2 and SUN RGB-D datasets, respectively. EPTH sensing is essential for various 3D tasks such as autonomous driving [1], robot navigation [2], [3], and scene reconstruction [4], [5]. However, raw depth images captured by current depth sensors, such as Time-of-Flight (TOF) and structured light devices like Microsoft Kinect [6] and Intel Realsense [7], often contain significant invalid areas. These regions arise from factors such as highly reflective or transparent surfaces and challenging lighting conditions. Zhang, Y ang Li and Z. Geng are with the Institute of Data and Information, Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen, Guangdong, China, 518071 (emails: zzh23@mails.tsinghua.edu.cn, Z. Wang is with School of Computer Science, Wuhan University, 430072, China (email: wangzwhu@whu.edu.cn). K. Jiang is with School of Computer Science and Technology, Harbin Institute of Technology, 150001, China (email: kuijiang 1994@163.com).
ITPP: Learning Disentangled Event Dynamics in Marked Temporal Point Processes
Zhou, Wang-Tao, Kang, Zhao, Yan, Ke, Tian, Ling
Marked Temporal Point Processes (MTPPs) provide a principled framework for modeling asynchronous event sequences by conditioning on the history of past events. However, most existing MTPP models rely on channel-mixing strategies that encode information from different event types into a single, fixed-size latent representation. This entanglement can obscure type-specific dynamics, leading to performance degradation and increased risk of overfitting. In this work, we introduce ITPP, a novel channel-independent architecture for MTPP modeling that decouples event type information using an encoder-decoder framework with an ODE-based backbone. Central to ITPP is a type-aware inverted self-attention mechanism, designed to explicitly model inter-channel correlations among heterogeneous event types. This architecture enhances effectiveness and robustness while reducing overfit-ting. Comprehensive experiments on multiple real-world and synthetic datasets demonstrate that ITPP consistently outperforms state-of-the-art MTPP models in both predictive accuracy and generalization.
One-Shot Knowledge Transfer for Scalable Person Re-Identification
Li, Longhua, Qi, Lei, Geng, Xin
Edge computing in person re-identification (ReID) is crucial for reducing the load on central cloud servers and ensuring user privacy. Conventional compression methods for obtaining compact models require computations for each individual student model. When multiple models of varying sizes are needed to accommodate different resource conditions, this leads to repetitive and cumbersome computations. To address this challenge, we propose a novel knowledge inheritance approach named OSKT (One-Shot Knowledge Transfer), which consolidates the knowledge of the teacher model into an intermediate carrier called a weight chain. When a downstream scenario demands a model that meets specific resource constraints, this weight chain can be expanded to the target model size without additional computation. OSKT significantly outperforms state-of-the-art compression methods, with the added advantage of one-time knowledge transfer that eliminates the need for frequent computations for each target model.
Robustness study of the bio-inspired musculoskeletal arm robot based on the data-driven iterative learning algorithm
Yuan, Jianbo, Dai, Jing, Fan, Yerui, Wu, Yaxiong, Liang, Yunpeng, Yan, Weixin
Traditional robotic systems excel in high-precision and large-load operations, but achieving tasks that require robustness, dexterity, and flexibility necessitates high-precision sensors, high-precision structures, and advanced control algorithms. In situations where the absolute precision of sensing and control in each unit is not high, the human arm can effectively utilize its inherent structural characteristics, such as the serial and parallel hybrid kinematic structure and the rigid-flexible coupling dynamic characteristics, to achieve rapid, robust, safe, dexterous, and flexible operations through information processing in neural circuits [1-3]. Through the synergy of software and hardware, developing a neuromorphic intelligent robot system that embodies human-like structural characteristics and driving mechanisms holds significant inspirational and catalytic value for advancing novel high-performance robotic systems. However, simulating the musculoskeletal structure with physical devices poses significant challenges. Michael et al. [4] created the'Anthrob' robot, which is a reduced version of the human upper limb with 13 compliant muscles and four joints, However, the complexity of muscle units makes the extension of multi-muscle actuation challenging.
Learning solutions of parameterized stiff ODEs using Gaussian processes
Garcia, Idoia Cortes, Fรถrster, P., Schilders, W., Schรถps, S.
Stiff ordinary differential equations (ODEs) play an important role in many scientific and engineering applications. Often, the dependence of the solution of the ODE on additional parameters is of interest, e.g.\ when dealing with uncertainty quantification or design optimization. Directly studying this dependence can quickly become too computationally expensive, such that cheaper surrogate models approximating the solution are of interest. One popular class of surrogate models are Gaussian processes (GPs). They perform well when approximating stationary functions, functions which have a similar level of variation along any given parameter direction, however solutions to stiff ODEs are often characterized by a mixture of regions of rapid and slow variation along the time axis and when dealing with such nonstationary functions, GP performance frequently degrades drastically. We therefore aim to reparameterize stiff ODE solutions based on the available data, to make them appear more stationary and hence recover good GP performance. This approach comes with minimal computational overhead and requires no internal changes to the GP implementation, as it can be seen as a separate preprocessing step. We illustrate the achieved benefits using multiple examples.
Bespoke Co-processor for Energy-Efficient Health Monitoring on RISC-V-based Flexible Wearables
Vergos, Theofanis, Vergos, Polykarpos, Tahoori, Mehdi B., Zervakis, Georgios
Flexible electronics offer unique advantages for conformable, lightweight, and disposable healthcare wearables. However, their limited gate count, large feature sizes, and high static power consumption make on-body machine learning classification highly challenging. While existing bendable RISC-V systems provide compact solutions, they lack the energy efficiency required. We present a mechanically flexible RISC-V that integrates a bespoke multiply-accumulate co-processor with fixed coefficients to maximize energy efficiency and minimize latency. Our approach formulates a constrained programming problem to jointly determine co-processor constants and optimally map Multi-Layer Perceptron (MLP) inference operations, enabling compact, model-specific hardware by leveraging the low fabrication and non-recurring engineering costs of flexible technologies. Post-layout results demonstrate near-real-time performance across several healthcare datasets, with our circuits operating within the power budget of existing flexible batteries and occupying only 2.42 mm^2, offering a promising path toward accessible, sustainable, and conformable healthcare wearables. Our microprocessors achieve an average 2.35x speedup and 2.15x lower energy consumption compared to the state of the art.
Runtime Safety Monitoring of Deep Neural Networks for Perception: A Survey
Schotschneider, Albert, Pavlitska, Svetlana, Zรถllner, J. Marius
Deep neural networks (DNNs) are widely used in perception systems for safety-critical applications, such as autonomous driving and robotics. However, DNNs remain vulnerable to various safety concerns, including generalization errors, out-of-distribution (OOD) inputs, and adversarial attacks, which can lead to hazardous failures. This survey provides a comprehensive overview of runtime safety monitoring approaches, which operate in parallel to DNNs during inference to detect these safety concerns without modifying the DNN itself. We categorize existing methods into three main groups: Monitoring inputs, internal representations, and outputs. We analyze the state-of-the-art for each category, identify strengths and limitations, and map methods to the safety concerns they address. In addition, we highlight open challenges and future research directions.
Are Time-Indexed Foundation Models the Future of Time Series Imputation?
Naour, Etienne Le, Nabil, Tahar, Petralia, Adrien, Agoua, Ghislain
Foundation models for time series imputation remain largely unexplored. Recently, two such models, TabPFN-TS and MoTM, have emerged. These models share a common philosophy that places them within the family of time-indexed foundation models. This paper presents the first large-scale empirical study of these models for zero-shot imputation, which enables missing value recovery without retraining across a wide range of scenarios. We conduct extensive univariate experiments across 33 out-of-domain datasets (approximately 1.3M imputation windows) and evaluate their ability to integrate covariates at inference time to improve accuracy without fine-tuning. Our results demonstrate that time-indexed foundation models are a powerful and practical step toward achieving general-purpose, zero-shot imputation for real-world time series.
Kunlun Anomaly Troubleshooter: Enabling Kernel-Level Anomaly Detection and Causal Reasoning for Large Model Distributed Inference
Liu, Yuyang, Cai, Jingjing, Ren, Jiayi, Zhou, Peng, Zhang, Danyang, Du, Yin, Li, Shijian
Anomaly troubleshooting for large model distributed inference (LMDI) remains a critical challenge. Resolving anomalies such as inference performance degradation or latency jitter in distributed system demands significant manual efforts from domain experts, resulting in extremely time-consuming diagnosis processes with relatively low accuracy. In this paper, we introduce Kunlun Anomaly Troubleshooter (KAT), the first anomaly troubleshooting framework tailored for LMDI. KAT addresses this problem through two core innovations. First, KAT exploits the synchronicity and consistency of GPU workers, innovatively leverages function trace data to precisely detect kernel-level anomalies and associated hardware components at nanosecond resolution. Second, KAT integrates these detection results into a domain-adapted LLM, delivering systematic causal reasoning and natural language interpretation of complex anomaly symptoms. Evaluations conducted in Alibaba Cloud Service production environment indicate that KAT achieves over 0.884 precision and 0.936 recall in anomaly detection, providing detail anomaly insights that significantly narrow down the diagnostic scope and improve both the efficiency and success rate of troubleshooting.
An Epistemic Perspective on Agent Awareness
Naumov, Pavel, Pavlova, Alexandra
The paper proposes to treat agent awareness as a form of knowledge, breaking the tradition in the existing literature on awareness. It distinguishes the de re and de dicto forms of such knowledge. The work introduces two modalities capturing these forms and formally specifies their meaning using a version of 2D-semantics. The main technical result is a sound and complete logical system describing the interplay between the two proposed modalities and the standard "knowledge of the fact" modality.