Hidden in plain sight: VLMs overlook their visual representations