Protecting Y our LLMs with Information Bottleneck