To Sink or Not to Sink: Visual Information Pathways in Large Vision-Language Models