SemVink: Advancing VLMs' Semantic Understanding of Optical Illusions via Visual Global Thinking
Li, Sifan, Cai, Yujun, Wang, Yiwei
–arXiv.org Artificial Intelligence
Vision-language models (VLMs) excel in semantic tasks but falter at a core human capability: detecting hidden content in optical illusions or AI-generated images through perceptual adjustments like zooming. We introduce HC-Bench, a benchmark of 112 images with hidden text, objects, and illusions, revealing that leading VLMs achieve near-zero accuracy (0-5.36%)-even with explicit prompting. Humans resolve such ambiguities instinctively, yet VLMs fail due to an overreliance on high-level semantics. Strikingly, we propose SemVink (Semantic Visual Thinking) by simply scaling images to low resolutions (32-128 pixels), which unlocks >99% accuracy by eliminating redundant visual noise. This exposes a critical architectural flaw: VLMs prioritize abstract reasoning over low-level visual operations crucial for real-world robustness. Our work urges a shift toward hybrid models integrating multi-scale processing, bridging the gap between computational vision and human cognition for applications in medical imaging, security, and beyond.
arXiv.org Artificial Intelligence
Oct-16-2025
- Country:
- North America > United States (1.00)
- Asia > Middle East
- UAE (0.28)
- Genre:
- Research Report (1.00)
- Industry:
- Information Technology > Security & Privacy (0.46)
- Health & Medicine
- Therapeutic Area (0.46)
- Health Care Technology (0.34)
- Diagnostic Medicine > Imaging (0.34)
- Technology: