Exploiting Contextual Knowledge in LLMs through V-usable Information based Layer Enhancement