Leveraging KV Similarity for Online Structured Pruning in LLMs