rul
RelativeUncertaintyLearningforFacialExpression RecognitionSupplementaryMaterial AVisualizationresultsonMNISTandCIFAR
Weprovide visualization results onMNIST and CIFAR toshowour uncertainty learning method also works well on datasets besides facial expression recognition (FER) tasks. Weutilize red rectangles to mark images that are misclassified and green rectangles to mark images that are rightly classified. They are usually very hard to be rightlyclassified. We also carry out experiments on MNIST and CIFAR with synthetic noises. If the maximum prediction probability is higher than the one of given label with a threshold (set to 0.2), we believe that sample contains label noise and then change the label to the index of the maximum prediction probability.
Contextual Candor: Enhancing LLM Trustworthiness Through Hierarchical Unanswerability Detection
Robinson, Steven, Rivera, Antonio Carlos
The pervasive deployment of large language models (LLMs) in conversational AI systems has revolutionized information access, yet their propensity for generating factually unsupported or hallucinated responses remains a critical impediment to trustworthiness and widespread adoption. This paper introduces Reinforced Unanswerability Learning (RUL), a novel hybrid training paradigm designed to imbue LLMs with the intrinsic capability to accurately detect unanswerable questions and generate reliably appropriate responses. Unlike conventional approaches that rely on external classifiers or simple prompting, RUL integrates a discriminative unanswerability prediction head with the LLM's generative core, guided by a multi-stage learning strategy. This includes supervised fine-tuning on a novel, richly annotated dataset, Enhanced-CAsT-Answerability (ECA), which features hierarchical answerability labels and ground-truth refusal responses. Crucially, RUL incorporates a subsequent reinforcement learning with human feedback (RLHF) phase to refine the nuance, helpfulness, and informativeness of refusal responses. Extensive experiments demonstrate RUL's superior performance, achieving significantly higher accuracy in unanswerability detection across sentence, paragraph, and ranking levels, and substantially increasing the generation of appropriate refusals for unanswerable queries, alongside strong performance on answerable questions. Human evaluations further corroborate RUL's effectiveness, highlighting a marked improvement in perceived helpfulness and trustworthiness, ultimately paving the way for more reliable and user-centric conversational AI.
End-to-End Framework for Predicting the Remaining Useful Life of Lithium-Ion Batteries
Tran, Khoa, Le, Tri, Huynh, Bao, Trinh, Hung-Cuong, Nguyen, Vy-Rin
Accurate prediction of the Remaining Useful Life (RUL) is essential for enabling timely maintenance of lithium-ion batteries, impacting the operational efficiency of electric applications that rely on them. This paper proposes a RUL prediction approach that leverages data from recent charge-discharge cycles to estimate the number of remaining usable cycles. The approach introduces both a novel signal processing pipeline and a deep learning prediction model. In the signal preprocessing pipeline, a derived capacity feature $\dot{Q}(I, Q)$ is computed based on current and capacity signals. Alongside original capacity, voltage and current, these features are denoised and enhanced using statistical metrics and a delta-based method to capture differences between the current and previous cycles. In the prediction model, the processed features are then fed into a hybrid deep learning architecture composed of 1D Convolutional Neural Networks (CNN), Attentional Long Short-Term Memory (A-LSTM), and Ordinary Differential Equation-based LSTM (ODE-LSTM) blocks. This architecture is designed to capture both local signal characteristics and long-range temporal dependencies while modeling the continuous-time dynamics of battery degradation. The model is further evaluated using transfer learning across different learning strategies and target data partitioning scenarios. Results indicate that the model maintains robust performance, even when fine-tuned on limited target data. Experimental results on two publicly available large-scale datasets demonstrate that the proposed method outperforms a baseline deep learning approach and machine learning techniques, achieving an RMSE of 101.59, highlighting its strong potential for real-world RUL prediction applications.
HybridoNet-Adapt: A Domain-Adapted Framework for Accurate Lithium-Ion Battery RUL Prediction
Tran, Khoa, Huynh, Bao, Le, Tri, Pham, Lam, Nguyen, Vy-Rin, Trinh, Hung-Cuong, Anh, Duong Tran
Accurate prediction of the Remaining Useful Life (RUL) in Lithium ion battery (LIB) health management systems is essential for ensuring operational reliability and safety. However, many existing methods assume that training and testing data follow the same distribution, limiting their ability to generalize to unseen target domains. To address this, we propose a novel RUL prediction framework that incorporates a domain adaptation (DA) technique. Our framework integrates a signal preprocessing pipeline including noise reduction, feature extraction, and normalization with a robust deep learning model called HybridoNet Adapt. The model features a combination of LSTM, Multihead Attention, and Neural ODE layers for feature extraction, followed by two predictor modules with trainable trade-off parameters. To improve generalization, we adopt a DA strategy inspired by Domain Adversarial Neural Networks (DANN), replacing adversarial loss with Maximum Mean Discrepancy (MMD) to learn domain-invariant features. Experimental results show that HybridoNet Adapt significantly outperforms traditional models such as XGBoost and Elastic Net, as well as deep learning baselines like Dual input DNN, demonstrating its potential for scalable and reliable battery health management (BHM).
A temporal scale transformer framework for precise remaining useful life prediction in fuel cells
Tang, Zezhi, Chen, Xiaoyu, Jin, Xin, Zhang, Benyuan, Liang, Wenyu
In exploring Predictive Health Management (PHM) strategies for Proton Exchange Membrane Fuel Cells (PEMFC), the Transformer model, widely used in data-driven approaches, excels in many fields but struggles with time series analysis due to its self-attention mechanism, which yields a complexity of the input sequence squared and low computational efficiency. It also faces challenges in capturing both global long-term dependencies and local details effectively. To tackle this, we propose the Temporal Scale Transformer (TSTransformer), an enhanced version of the inverted Transformer (iTransformer). Unlike traditional Transformers that treat each timestep as an input token, TSTransformer maps sequences of varying lengths into tokens at different stages for inter-sequence modeling, using attention to capture multivariate correlations and feed-forward networks (FFN) to encode sequence representations. By integrating a one-dimensional convolutional layer into the multivariate attention for multi-level scaling of K and V matrices, it improves local feature extraction, captures temporal scale characteristics, and reduces token count and computational costs. Experiments comparing TSTransformer with models like Long Short-Term Memory, iTransformer, and Transformer demonstrate its potential as a powerful tool for advancing PHM in renewable energy, effectively addressing the limitations of pure Transformer models in data-driven time series tasks.
BACE-RUL: A Bi-directional Adversarial Network with Covariate Encoding for Machine Remaining Useful Life Prediction
Zhang, Zekai, Li, Dan, Wu, Shunyu, Cai, Junya, Zhang, Bo, Ng, See Kiong, Zheng, Zibin
Prognostic and Health Management (PHM) are crucial ways to avoid unnecessary maintenance for Cyber-Physical Systems (CPS) and improve system reliability. Predicting the Remaining Useful Life (RUL) is one of the most challenging tasks for PHM. Existing methods require prior knowledge about the system, contrived assumptions, or temporal mining to model the life cycles of machine equipment/devices, resulting in diminished accuracy and limited applicability in real-world scenarios. This paper proposes a Bi-directional Adversarial network with Covariate Encoding for machine Remaining Useful Life (BACE-RUL) prediction, which only adopts sensor measurements from the current life cycle to predict RUL rather than relying on previous consecutive cycle recordings. The current sensor measurements of mechanical devices are encoded to a conditional space to better understand the implicit inner mechanical status. The predictor is trained as a conditional generative network with the encoded sensor measurements as its conditions. Various experiments on several real-world datasets, including the turbofan aircraft engine dataset and the dataset collected from degradation experiments of Li-Ion battery cells, show that the proposed model is a general framework and outperforms state-of-the-art methods.
RUL forecasting for wind turbine predictive maintenance based on deep learning
Shah, Syed Shazaib, Daoliang, Tan, Kumar, Sah Chandan
In order to keep up with the rising demand, the wind industry is actively working to make it more viable and competitive, which means tackling some of the biggest challenges it faces [3,4]. A survey analysis [5] shows that approximately 45% of the overall budget might be set aside for operation and maintenance (O&M), as shown in Figure 1, posing as one of the biggest challenges faced by the wind industry. To counter this, preventive maintenance (PM) could be employed, which follows a periodically scheduled maintenance plan to reduce unplanned maintenance. However, this leads to unnecessary downtime, as often times the maintenance is not required [6-8]. This could be resolved if predictive maintenance (PdM) could be achieved. PdM predicts the optimal time for maintenance, ensuring it is performed precisely when needed and avoiding unnecessary machine stoppages [9]. One way to achieve this is by analyzing the remaining useful life (RUL) of the turbine and scheduling maintenance immediately prior to failure [10]. However, wind farms are often located in remote locations, usually spanning over many miles [11,12]; especially in the case of off-shore wind farms [13,14]; and timely arrival becomes an issue as a result.