DIQ-H: Evaluating Hallucination Persistence in VLMs Under Temporal Visual Degradation
Lin, Zexin, Wan, Hawen, Zhong, Yebin, Xiaoqiang, null
–arXiv.org Artificial Intelligence
Vision-Language Models (VLMs) deployed in safety-critical applications such as autonomous driving must handle continuous visual streams under imperfect conditions. However, existing benchmarks focus on static, high-quality images and ignore temporal degradation and error propagation, which are critical failure modes where transient visual corruption induces hallucinations that persist across subsequent frames. We introduce DIQ-H, the first benchmark for evaluating VLM robustness under dynamic visual degradation in temporal sequences. DIQ-H applies physics-based corruptions including motion blur, sensor noise, and compression artifacts, and measures hallucination persistence, error recovery, and temporal consistency through multi-turn question-answering tasks. To enable scalable annotation, we propose Uncertainty-Guided Iterative Refinement (UIR), which generates reliable pseudo-ground-truth using lightweight VLMs with uncertainty filtering, achieving a 15.3 percent accuracy improvement. Experiments on 16 state-of-the-art VLMs reveal substantial robustness gaps: even advanced models such as GPT-4o achieve only a 78.5 percent recovery rate, while open-source models struggle with temporal consistency at less than 60 percent. DIQ-H provides a comprehensive platform for evaluating VLM reliability in real-world deployments.
arXiv.org Artificial Intelligence
Dec-4-2025
- Country:
- Asia
- China
- Guangdong Province > Shenzhen (0.05)
- Hong Kong (0.04)
- Middle East > Qatar
- China
- Oceania > Australia
- New South Wales > Sydney (0.04)
- Asia
- Genre:
- Research Report (0.82)
- Industry:
- Information Technology (0.34)
- Technology:
- Information Technology > Artificial Intelligence
- Machine Learning > Neural Networks
- Deep Learning (0.68)
- Natural Language
- Chatbot (0.68)
- Large Language Model (0.89)
- Representation & Reasoning > Agents (0.69)
- Vision (1.00)
- Machine Learning > Neural Networks
- Information Technology > Artificial Intelligence