abnormal pattern
Normal-Abnormal Guided Generalist Anomaly Detection
Wang, Yuexin, Wang, Xiaolei, Gong, Yizheng, Xiao, Jimin
Generalist Anomaly Detection (GAD) aims to train a unified model on an original domain that can detect anomalies in new target domains. Previous GAD methods primarily use only normal samples as references, overlooking the valuable information contained in anomalous samples that are often available in real-world scenarios. To address this limitation, we propose a more practical approach: normal-abnormal-guided generalist anomaly detection, which leverages both normal and anomalous samples as references to guide anomaly detection across diverse domains. We introduce the Normal-Abnormal Generalist Learning (NAGL) framework, consisting of two key components: Residual Mining (RM) and Anomaly Feature Learning (AFL). RM extracts abnormal patterns from normal-abnormal reference residuals to establish transferable anomaly representations, while AFL adaptively learns anomaly features in query images through residual mapping to identify instance-aware anomalies. Our approach effectively utilizes both normal and anomalous references for more accurate and efficient cross-domain anomaly detection. Extensive experiments across multiple benchmarks demonstrate that our method significantly outperforms existing GAD approaches. This work represents the first to adopt a mixture of normal and abnormal samples as references in generalist anomaly detection. The code and datasets are available at https://github.com/JasonKyng/NAGL.
- Asia > China > Shaanxi Province > Xi'an (0.04)
- Asia > China > Jiangsu Province (0.04)
- Research Report > Experimental Study (1.00)
- Research Report > New Finding (0.67)
- Health & Medicine > Diagnostic Medicine (0.67)
- Information Technology > Security & Privacy (0.46)
An Identifiable Cost-Aware Causal Decision-Making Framework Using Counterfactual Reasoning
Cai, Ruichu, Chen, Xi, Qiao, Jie, Li, Zijian, Liu, Yuequn, Chen, Wei, Zhang, Keli, Zheng, Jiale
Decision making under abnormal conditions is a critical process that involves evaluating the current state and determining the optimal action to restore the system to a normal state at an acceptable cost. However, in such scenarios, existing decision-making frameworks highly rely on reinforcement learning or root cause analysis, resulting in them frequently neglecting the cost of the actions or failing to incorporate causal mechanisms adequately. By relaxing the existing causal decision framework to solve the necessary cause, we propose a minimum-cost causal decision (MiCCD) framework via counterfactual reasoning to address the above challenges. Emphasis is placed on making counterfactual reasoning processes identifiable in the presence of a large amount of mixed anomaly data, as well as finding the optimal intervention state in a continuous decision space. Specifically, it formulates a surrogate model based on causal graphs, using abnormal pattern clustering labels as supervisory signals. This enables the approximation of the structural causal model among the variables and lays a foundation for identifiable counterfactual reasoning. With the causal structure approximated, we then established an optimization model based on counterfactual estimation. The Sequential Least Squares Programming (SLSQP) algorithm is further employed to optimize intervention strategies while taking costs into account. Experimental evaluations on both synthetic and real-world datasets reveal that MiCCD outperforms conventional methods across multiple metrics, including F1-score, cost efficiency, and ranking quality(nDCG@k values), thus validating its efficacy and broad applicability.
- Asia > Middle East > Jordan (0.14)
- Asia > China > Beijing > Beijing (0.04)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- (3 more...)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Optimization (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Statistical Learning > Clustering (0.48)
Transferring self-supervised pre-trained models for SHM data anomaly detection with scarce labeled data
Zhou, Mingyuan, Jian, Xudong, Xia, Ye, Lai, Zhilu
Structural health monitoring (SHM) has experienced significant advancements in recent decades, accumulating massive monitoring data. Data anomalies inevitably exist in monitoring data, posing significant challenges to their effective utilization. Recently, deep learning has emerged as an efficient and effective approach for anomaly detection in bridge SHM. Despite its progress, many deep learning models require large amounts of labeled data for training. The process of labeling data, however, is labor-intensive, time-consuming, and often impractical for large-scale SHM datasets. To address these challenges, this work explores the use of self-supervised learning (SSL), an emerging paradigm that combines unsupervised pre-training and supervised fine-tuning. The SSL-based framework aims to learn from only a very small quantity of labeled data by fine-tuning, while making the best use of the vast amount of unlabeled SHM data by pre-training. Mainstream SSL methods are compared and validated on the SHM data of two in-service bridges. Comparative analysis demonstrates that SSL techniques boost data anomaly detection performance, achieving increased F1 scores compared to conventional supervised training, especially given a very limited amount of labeled data. This work manifests the effectiveness and superiority of SSL techniques on large-scale SHM data, providing an efficient tool for preliminary anomaly detection with scarce label information.
Machine Learning for Complex Systems with Abnormal Pattern by Exception Maximization Outlier Detection Method
Zhang, Zhikun, Duan, Yiting, Wang, Xiangjun, Zhang, Mingyuan
This paper proposes a novel fast online methodology for outlier detection called the exception maximization outlier detection method(EMODM), which employs probabilistic models and statistical algorithms to detect abnormal patterns from the outputs of complex systems. The EMODM is based on a two-state Gaussian mixture model and demonstrates strong performance in probability anomaly detection working on real-time raw data rather than using special prior distribution information. We confirm this using the synthetic data from two numerical cases. For the real-world data, we have detected the short circuit pattern of the circuit system using EMODM by the current and voltage output of a three-phase inverter. The EMODM also found an abnormal period due to COVID-19 in the insured unemployment data of 53 regions in the United States from 2000 to 2024. The application of EMODM to these two real-life datasets demonstrated the effectiveness and accuracy of our algorithm.
- North America > United States > New York (0.04)
- North America > United States > California (0.04)
- Asia > China > Hubei Province > Wuhan (0.04)
- (2 more...)
- Banking & Finance > Economy (1.00)
- Health & Medicine > Therapeutic Area > Infections and Infectious Diseases (0.35)
- Health & Medicine > Therapeutic Area > Immunology (0.35)
Effective Abnormal Activity Detection on Multivariate Time Series Healthcare Data
Niu, Mengjia, Zhao, Yuchen, Haddadi, Hamed
Multivariate time series (MTS) data collected from multiple sensors provide the potential for accurate abnormal activity detection in smart healthcare scenarios. However, anomalies exhibit diverse patterns and become unnoticeable in MTS data. Consequently, achieving accurate anomaly detection is challenging since we have to capture both temporal dependencies of time series and inter-relationships among variables. To address this problem, we propose a Residual-based Anomaly Detection approach, Rs-AD, for effective representation learning and abnormal activity detection. We evaluate our scheme on a real-world gait dataset and the experimental results demonstrate an F1 score of 0.839.
- North America > United States > California > Orange County > Irvine (0.15)
- Europe > Spain > Galicia > Madrid (0.06)
- Europe > United Kingdom > England > Greater London > London (0.05)
- (3 more...)
- Information Technology > Security & Privacy (0.41)
- Health & Medicine > Consumer Health (0.41)
OpenAPMax: Abnormal Patterns-based Model for Real-World Alzheimer's Disease Diagnosis
Huang, Yunyou, Guan, Xianglong, Lu, Xiangjiang, Liang, Xiaoshuang, Miao, Xiuxia, Xie, Jiyue, Liu, Wenjing, Ma, Li, Tang, Suqin, Zhang, Zhifei, Zhan, Jianfeng
Alzheimer's disease (AD) cannot be reversed, but early diagnosis will significantly benefit patients' medical treatment and care. In recent works, AD diagnosis has the primary assumption that all categories are known a prior -- a closed-set classification problem, which contrasts with the open-set recognition problem. This assumption hinders the application of the model in natural clinical settings. Although many open-set recognition technologies have been proposed in other fields, they are challenging to use for AD diagnosis directly since 1) AD is a degenerative disease of the nervous system with similar symptoms at each stage, and it is difficult to distinguish from its pre-state, and 2) diversified strategies for AD diagnosis are challenging to model uniformly. In this work, inspired by the concerns of clinicians during diagnosis, we propose an open-set recognition model, OpenAPMax, based on the anomaly pattern to address AD diagnosis in real-world settings. OpenAPMax first obtains the abnormal pattern of each patient relative to each known category through statistics or a literature search, clusters the patients' abnormal pattern, and finally, uses extreme value theory (EVT) to model the distance between each patient's abnormal pattern and the center of their category and modify the classification probability. We evaluate the performance of the proposed method with recent open-set recognition, where we obtain state-of-the-art results.
- Information Technology > Artificial Intelligence > Representation & Reasoning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Statistical Learning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (1.00)
- Information Technology > Data Science > Data Mining (0.93)
Machine learning algorithm uses brain scans to predict language ability in deaf children
In a new international collaborative study between The Chinese University of Hong Kong and Ann & Robert H. Lurie Children's Hospital of Chicago, researchers created a machine learning algorithm that uses brain scans to predict language ability in deaf children after they receive a cochlear implant. This study's novel use of artificial intelligence to understand brain structure underlying language development has broad reaching implications for children with developmental challenges. It was published in the Proceedings of the National Academy of Sciences of the United States of America. "The ability to predict language development is important because it allows clinicians and educators to intervene with therapy to maximize language learning for the child," said co-senior author Patrick C. M. Wong, PhD, a cognitive neuroscientist, professor and director of the Brain and Mind Institute at The Chinese University of Hong Kong. "Since the brain underlies all human ability, the methods we have applied to children with hearing loss could have widespread use in predicting function and improving the lives of children with a broad range of disabilities" said Wong.
- Asia > China > Hong Kong (0.47)
- North America > United States > Illinois > Cook County > Chicago (0.26)
- Health & Medicine > Therapeutic Area > Otolaryngology (1.00)
- Health & Medicine > Therapeutic Area > Neurology (1.00)