syncnet
Lost in Time? A Meta-Learning Framework for Time-Shift-Tolerant Physiological Signal Transformation
Hong, Qian, Bian, Cheng, Zhou, Xiao, Li, Xiaoyu, Li, Yelei, Zeng, Zijing
Translating non-invasive signals such as photoplethysmography (PPG) and ballistocardiography (BCG) into clinically meaningful signals like arterial blood pressure (ABP) is vital for continuous, low-cost healthcare monitoring. However, temporal misalignment in multimodal signal transformation impairs transformation accuracy, especially in capturing critical features like ABP peaks. Conventional synchronization methods often rely on strong similarity assumptions or manual tuning, while existing Learning with Noisy Labels (LNL) approaches are ineffective under time-shifted supervision, either discarding excessive data or failing to correct label shifts. To address this challenge, we propose ShiftSyncNet, a meta-learning-based bi-level optimization framework that automatically mitigates performance degradation due to time misalignment. It comprises a transformation network (TransNet) and a time-shift correction network (SyncNet), where SyncNet learns time offsets between training pairs and applies Fourier phase shifts to align supervision signals. Experiments on one real-world industrial dataset and two public datasets show that ShiftSyncNet outperforms strong baselines by 9.4%, 6.0%, and 12.8%, respectively. The results highlight its effectiveness in correcting time shifts, improving label quality, and enhancing transformation accuracy across diverse misalignment scenarios, pointing toward a unified direction for addressing temporal inconsistencies in multimodal physiological transformation.
- Asia > China > Beijing > Beijing (0.04)
- Asia > South Korea > Seoul > Seoul (0.04)
- Asia > Middle East > Israel (0.04)
- Asia > China > Guangdong Province > Shenzhen (0.04)
- Research Report > New Finding (0.46)
- Research Report > Experimental Study (0.46)
Reviews: Targeting EEG/LFP Synchrony with Neural Nets
The manuscript introduces the novel CNN named SyncNet, which was designed to detect synchrony/spectral coherence in brain electrophysiological signals. To overcome common issues in EEG (varying setup configuration, correlated channels, ...) a Gaussian Process Adaptor is used to transform EEG data into a pseudo input space. The design of SyncNet is chosen to allow interpretation of learned featruers. The method was applied to several publicly available datasets and its performance compared to state of the art algorithms. Results suggest that SyncNet yields competitive results.
Targeting EEG/LFP Synchrony with Neural Nets
Yitong Li, michael Murias, samantha Major, geraldine Dawson, Kafui Dzirasa, Lawrence Carin, David E. Carlson
We consider the analysis of Electroencephalography (EEG) and Local Field Potential (LFP) datasets, which are "big" in terms of the size of recorded data but rarely have sufficient labels required to train complex models (e.g., conventional deep learning methods). Furthermore, in many scientific applications, the goal is to be able to understand the underlying features related to the classification, which prohibits the blind application of deep networks. This motivates the development of a new model based on parameterized convolutional filters guided by previous neuroscience research; the filters learn relevant frequency bands while targeting synchrony, which are frequency-specific power and phase correlations between electrodes.
- Research Report > New Finding (0.46)
- Research Report > Experimental Study (0.46)
Latency-Aware Collaborative Perception
Lei, Zixing, Ren, Shunli, Hu, Yue, Zhang, Wenjun, Chen, Siheng
Collaborative perception has recently shown great potential to improve perception capabilities over single-agent perception. Existing collaborative perception methods usually consider an ideal communication environment. However, in practice, the communication system inevitably suffers from latency issues, causing potential performance degradation and high risks in safety-critical applications, such as autonomous driving. To mitigate the effect caused by the inevitable latency, from a machine learning perspective, we present the first latency-aware collaborative perception system, which actively adapts asynchronous perceptual features from multiple agents to the same time stamp, promoting the robustness and effectiveness of collaboration. To achieve such a feature-level synchronization, we propose a novel latency compensation module, called SyncNet, which leverages feature-attention symbiotic estimation and time modulation techniques. Experiments results show that the proposed latency aware collaborative perception system with SyncNet can outperforms the state-of-the-art collaborative perception method by 15.6% in the communication latency scenario and keep collaborative perception being superior to single agent perception under severe latency.
- Transportation > Ground > Road (0.35)
- Automobiles & Trucks (0.35)
- Information Technology (0.35)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (1.00)
- Information Technology > Artificial Intelligence > Vision (0.91)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Agents (0.90)
- Information Technology > Artificial Intelligence > Robots (0.90)
Targeting EEG/LFP Synchrony with Neural Nets
Li, Yitong, Murias, michael, Major, samantha, Dawson, geraldine, Dzirasa, Kafui, Carin, Lawrence, Carlson, David E.
We consider the analysis of Electroencephalography (EEG) and Local Field Potential (LFP) datasets, which are “big” in terms of the size of recorded data but rarely have sufficient labels required to train complex models (e.g., conventional deep learning methods). Furthermore, in many scientific applications, the goal is to be able to understand the underlying features related to the classification, which prohibits the blind application of deep networks. This motivates the development of a new model based on {\em parameterized} convolutional filters guided by previous neuroscience research; the filters learn relevant frequency bands while targeting synchrony, which are frequency-specific power and phase correlations between electrodes. This results in a highly expressive convolutional neural network with only a few hundred parameters, applicable to smaller datasets. The proposed approach is demonstrated to yield competitive (often state-of-the-art) predictive performance during our empirical tests while yielding interpretable features. Furthermore, a Gaussian process adapter is developed to combine analysis over distinct electrode layouts, allowing the joint processing of multiple datasets to address overfitting and improve generalizability. Finally, it is demonstrated that the proposed framework effectively tracks neural dynamics on children in a clinical trial on Autism Spectrum Disorder.
- Research Report > New Finding (0.66)
- Research Report > Experimental Study (0.66)