Chen, Junru
Deep Learning-Powered Electrical Brain Signals Analysis: Advancing Neurological Diagnostics
Li, Jiahe, Chen, Xin, Shen, Fanqi, Chen, Junru, Liu, Yuxin, Zhang, Daoze, Yuan, Zhizhang, Zhao, Fang, Li, Meng, Yang, Yang
Neurological disorders represent significant global health challenges, driving the advancement of brain signal analysis methods. Scalp electroencephalography (EEG) and intracranial electroencephalography (iEEG) are widely used to diagnose and monitor neurological conditions. However, dataset heterogeneity and task variations pose challenges in developing robust deep learning solutions. This review systematically examines recent advances in deep learning approaches for EEG/iEEG-based neurological diagnostics, focusing on applications across 7 neurological conditions using 46 datasets. We explore trends in data utilization, model design, and task-specific adaptations, highlighting the importance of pre-trained multi-task models for scalable, generalizable solutions. To advance research, we propose a standardized benchmark for evaluating models across diverse datasets to enhance reproducibility. This survey emphasizes how recent innovations can transform neurological diagnostics and enable the development of intelligent, adaptable healthcare solutions.
Brant-2: Foundation Model for Brain Signals
Yuan, Zhizhang, Zhang, Daoze, Chen, Junru, Gu, Gefei, Yang, Yang
Foundational models benefit from pre-training on large amounts of unlabeled data and enable strong performance in a wide variety of applications with a small amount of labeled data. Such models can be particularly effective in analyzing brain signals, as this field encompasses numerous application scenarios, and it is costly to perform large-scale annotation. In this work, we present the largest foundation model in brain signals, Brant-2. Compared to Brant, a foundation model designed for intracranial neural signals, Brant-2 not only exhibits robustness towards data variations and modeling scales but also can be applied to a broader range of brain neural data. By experimenting on an extensive range of tasks, we demonstrate that Brant-2 is adaptive to various application scenarios in brain signals. Further analyses reveal the scalability of the Brant-2, validate each component's effectiveness, and showcase our model's ability to maintain performance in scenarios with scarce labels.
Are Synthetic Time-series Data Really not as Good as Real Data?
Fu, Fanzhe, Chen, Junru, Zhang, Jing, Yang, Carl, Ma, Lvbin, Yang, Yang
Integrating universal Issues: The fine-tuning process for temporal data needs data synthesis methods holds promise in improving to be handled carefully as it may contain adversarial or noisy generalization. However, current methods cannot examples, which could impact the model's robustness; (2) guarantee that the generator's output covers Bias and Vulnerabilities: The use of temporal data may all unseen real data. In this paper, we introduce cause the model to inherit biases or vulnerabilities from the InfoBoost-a highly versatile cross-domain data data, thereby reducing its robustness in real-world applications; synthesizing framework with time series representation (3) Generalization Problems: Despite being trained learning capability. We have developed on vast datasets, time-series models may not generalize a method based on synthetic data that enables well to unseen or out-of-distribution data. Time-series and model training without the need for real data, surpassing spatio-temporal data may exhibit sudden shifts or trends, the performance of models trained with potentially leading to unreliable outputs, highlighting the real data. Additionally, we have trained a universal need for robust generalization (Jin et al., 2023).
BrainNet: Epileptic Wave Detection from SEEG with Hierarchical Graph Diffusion Learning
Chen, Junru, Yang, Yang, Yu, Tao, Fan, Yingying, Mo, Xiaolong, Yang, Carl
Epilepsy is one of the most serious neurological diseases, affecting 1-2% of the world's population. The diagnosis of epilepsy depends heavily on the recognition of epileptic waves, i.e., disordered electrical brainwave activity in the patient's brain. Existing works have begun to employ machine learning models to detect epileptic waves via cortical electroencephalogram (EEG). However, the recently developed stereoelectrocorticography (SEEG) method provides information in stereo that is more precise than conventional EEG, and has been broadly applied in clinical practice. Therefore, we propose the first data-driven study to detect epileptic waves in a real-world SEEG dataset. While offering new opportunities, SEEG also poses several challenges. In clinical practice, epileptic wave activities are considered to propagate between different regions in the brain. These propagation paths, also known as the epileptogenic network, are deemed to be a key factor in the context of epilepsy surgery. However, the question of how to extract an exact epileptogenic network for each patient remains an open problem in the field of neuroscience. To address these challenges, we propose a novel model (BrainNet) that jointly learns the dynamic diffusion graphs and models the brain wave diffusion patterns. In addition, our model effectively aids in resisting label imbalance and severe noise by employing several self-supervised learning tasks and a hierarchical framework. By experimenting with the extensive real SEEG dataset obtained from multiple patients, we find that BrainNet outperforms several latest state-of-the-art baselines derived from time-series analysis.
MBrain: A Multi-channel Self-Supervised Learning Framework for Brain Signals
Cai, Donghong, Chen, Junru, Yang, Yang, Liu, Teng, Li, Yafeng
Brain signals are important quantitative data for understanding physiological activities and diseases of human brain. Most existing studies pay attention to supervised learning methods, which, however, require high-cost clinical labels. In addition, the huge difference in the clinical patterns of brain signals measured by invasive (e.g., SEEG) and non-invasive (e.g., EEG) methods leads to the lack of a unified method. To handle the above issues, we propose to study the self-supervised learning (SSL) framework for brain signals that can be applied to pre-train either SEEG or EEG data. Intuitively, brain signals, generated by the firing of neurons, are transmitted among different connecting structures in human brain. Inspired by this, we propose MBrain to learn implicit spatial and temporal correlations between different channels (i.e., contacts of the electrode, corresponding to different brain areas) as the cornerstone for uniformly modeling different types of brain signals. Specifically, we represent the spatial correlation by a graph structure, which is built with proposed multi-channel CPC. We theoretically prove that optimizing the goal of multi-channel CPC can lead to a better predictive representation and apply the instantaneou-time-shift prediction task based on it. Then we capture the temporal correlation by designing the delayed-time-shift prediction task. Finally, replace-discriminative-learning task is proposed to preserve the characteristics of each channel. Extensive experiments of seizure detection on both EEG and SEEG large-scale real-world datasets demonstrate that our model outperforms several state-of-the-art time series SSL and unsupervised models, and has the ability to be deployed to clinical practice.
Vehicle Re-identification Method Based on Vehicle Attribute and Mutual Exclusion Between Cameras
Chen, Junru, Geng, Shiqing, Yan, Yongluan, Huang, Danyang, Liu, Hao, Li, Yadong
Vehicle Re-identification aims to identify a specific vehicle across time and camera view. With the rapid growth of intelligent transportation systems and smart cities, vehicle Re-identification technology gets more and more attention. However, due to the difference of shooting angle and the high similarity of vehicles belonging to the same brand, vehicle re-identification becomes a great challenge for existing method. In this paper, we propose a vehicle attribute-guided method to re-rank vehicle Re-ID result. The attributes used include vehicle orientation and vehicle brand . We also focus on the camera information and introduce camera mutual exclusion theory to further fine-tune the search results. In terms of feature extraction, we combine the data augmentations of multi-resolutions with the large model ensemble to get a more robust vehicle features. Our method achieves mAP of 63.73% and rank-1 accuracy 76.61% in the CVPR 2021 AI City Challenge.
Unsupervised Adversarially-Robust Representation Learning on Graphs
Xu, Jiarong, Chen, Junru, Yang, Yang, Sun, Yizhou, Wang, Chunping, Lu, Jiangang
Recent works have demonstrated that deep learning on graphs is vulnerable to adversarial attacks, in that imperceptible perturbations on input data can lead to dramatic performance deterioration. In this paper, we focus on the underlying problem of learning robust representations on graphs via mutual information. In contrast to previous works measure the task-specific robustness based on the label space, we here take advantage of the representation space to study a task-free robustness measure given the joint input space w.r.t graph topology and node attributes. We formulate this problem as a constrained saddle point optimization problem and solve it efficiently in a reduced search space. Furthermore, we provably establish theoretical connections between our task-free robustness measure and the robustness of downstream classifiers. Extensive experiments demonstrate that our proposed method is able to enhance robustness against adversarial attacks on graphs, yet even increases natural accuracy.