Interpretable AI for Time-Series: Multi-Model Heatmap Fusion with Global Attention and NLP-Generated Explanations
Francis, Jiztom Kavalakkatt, Darr, Matthew J
–arXiv.org Artificial Intelligence
In this paper, we present a novel framework for enhancing model interpretability by integrating heatmaps produced separately by ResNet and a restructured 2D Transformer with globally weighted input saliency. We address the critical problem of spatial-temporal misalignment in existing interpretability methods, where convolutional networks fail to capture global context and Transformers lack localized precision - a limitation that impedes actionable insights in safety-critical domains like healthcare and industrial monitoring. Our method merges gradient-weighted activation maps (ResNet) and Transformer attention rollout into a unified visualization, achieving full spatial-temporal alignment while preserving real-time performance. Empirical evaluations on clinical (ECG arrhythmia detection) and industrial (energy consumption prediction) datasets demonstrate significant improvements: the hybrid framework achieves 94.1% accuracy (F1 0.93) on the PhysioNet dataset and reduces regression error to RMSE = 0.28 kWh (R2 = 0.95) on the UCI Energy Appliance dataset-outperforming standalone ResNet, Transformer, and InceptionTime baselines by 3.8-12.4%. An NLP module translates fused heatmaps into domain-specific narratives (e.g., "Elevated ST-segment between 2-4 seconds suggests myocardial ischemia"), validated via BLEU-4 (0.586) and ROUGE-L (0.650) scores. By formalizing interpretability as causal fidelity and spatial-temporal alignment, our approach bridges the gap between technical outputs and stakeholder understanding, offering a scalable solution for transparent, time-aware decision-making.
arXiv.org Artificial Intelligence
Jul-2-2025
- Country:
- Asia > India
- Tamil Nadu > Chennai (0.04)
- Europe > Belgium (0.04)
- North America
- Canada > Quebec
- Montreal (0.04)
- United States
- Iowa > Story County
- Ames (0.04)
- Kentucky > Fayette County
- Lexington (0.14)
- New Jersey > Hudson County
- Hoboken (0.04)
- Ohio > Franklin County
- Columbus (0.04)
- Iowa > Story County
- Canada > Quebec
- Asia > India
- Genre:
- Research Report
- Experimental Study (0.68)
- New Finding (0.46)
- Research Report
- Industry:
- Energy (1.00)
- Health & Medicine
- Diagnostic Medicine (1.00)
- Therapeutic Area > Cardiology/Vascular Diseases (1.00)
- Information Technology (1.00)
- Technology: