Liu, Haifei
UBMF: Uncertainty-Aware Bayesian Meta-Learning Framework for Fault Diagnosis with Imbalanced Industrial Data
Lian, Zhixuan, Li, Shangyu, Huang, Qixuan, Huang, Zijian, Liu, Haifei, Qiu, Jianan, Yang, Puyu, Tao, Laifa
Fault diagnosis of mechanical equipment involves data collection, feature extraction, and pattern recognition but is often hindered by the imbalanced nature of industrial data, introducing significant uncertainty and reducing diagnostic reliability. To address these challenges, this study proposes the Uncertainty-Aware Bayesian Meta-Learning Framework (UBMF), which integrates four key modules: data perturbation injection for enhancing feature robustness, cross-task self-supervised feature extraction for improving transferability, uncertainty-based sample filtering for robust out-of-domain generalization, and Bayesian meta-knowledge integration for fine-grained classification. Experimental results on ten open-source datasets under various imbalanced conditions, including cross-task, small-sample, and unseen-sample scenarios, demonstrate the superiority of UBMF, achieving an average improvement of 42.22% across ten Any-way 1-5-shot diagnostic tasks. This integrated framework effectively enhances diagnostic accuracy, generalization, and adaptability, providing a reliable solution for complex industrial fault diagnosis.
Pre-Trained Large Language Model Based Remaining Useful Life Transfer Prediction of Bearing
Tao, Laifa, Zhao, Zhengduo, Wang, Xuesong, Li, Bin, Zhan, Wenchao, Su, Xuanyuan, Li, Shangyu, Huang, Qixuan, Liu, Haifei, Lu, Chen, Lian, Zhixuan
Accurately predicting the remaining useful life (RUL) of rotating machinery, such as bearings, is crucial for equipment reliability and minimizing unexpected failures in industrial systems. Despite recent advancements, data-driven deep learning methods face challenges in practical industrial settings due to inconsistent data distributions between training and testing phases, and limited generalization capabilities for long-term RUL predictions. To address these issues, we propose LM4RUL, a framework for RUL prediction based on pre-trained Large language Model (LLM). LM4RUL leverages the generalization and reasoning capabilities of LLM to transfer predictive knowledge from pre-training, effectively overcoming data inconsistencies and enhancing prediction accuracy. This represents a meaningful advancement in the artificial intelligence field, being among the first efforts to successfully apply LLM to RUL prediction tasks without the need for additional manual instruction, thereby extending the boundaries of AI applications beyond natural language processing and into complex industrial scenarios. The framework includes the local scale perception representation component, which captures fine-grained bearing degradation trends by tokenizing vibration data, and hybrid embedding learning, which selectively freezes and fine-tunes parameters to model complex nonlinear degradation.
An Outline of Prognostics and Health Management Large Model: Concepts, Paradigms, and Challenges
Tao, Laifa, Li, Shangyu, Liu, Haifei, Huang, Qixuan, Ma, Liang, Ning, Guoao, Chen, Yiling, Wu, Yunlong, Li, Bin, Zhang, Weiwei, Zhao, Zhengduo, Zhan, Wenchao, Cao, Wenyan, Wang, Chao, Liu, Hongmei, Ma, Jian, Suo, Mingliang, Cheng, Yujie, Ding, Yu, Song, Dengwei, Lu, Chen
Prognosis and Health Management (PHM), critical for ensuring task completion by complex systems and preventing unexpected failures, is widely adopted in aerospace, manufacturing, maritime, rail, energy, etc. However, PHM's development is constrained by bottlenecks like generalization, interpretation and verification abilities. Presently, generative artificial intelligence (AI), represented by Large Model, heralds a technological revolution with the potential to fundamentally reshape traditional technological fields and human production methods. Its capabilities, including strong generalization, reasoning, and generative attributes, present opportunities to address PHM's bottlenecks. To this end, based on a systematic analysis of the current challenges and bottlenecks in PHM, as well as the research status and advantages of Large Model, we propose a novel concept and three progressive paradigms of Prognosis and Health Management Large Model (PHM-LM) through the integration of the Large Model with PHM. Subsequently, we provide feasible technical approaches for PHM-LM to bolster PHM's core capabilities within the framework of the three paradigms. Moreover, to address core issues confronting PHM, we discuss a series of technical challenges of PHM-LM throughout the entire process of construction and application. This comprehensive effort offers a holistic PHM-LM technical framework, and provides avenues for new PHM technologies, methodologies, tools, platforms and applications, which also potentially innovates design, research & development, verification and application mode of PHM. And furthermore, a new generation of PHM with AI will also capably be realized, i.e., from custom to generalized, from discriminative to generative, and from theoretical conditions to practical applications.