Surgical Feature-Space Decomposition of LLMs: Why, When and How?