Where and What Matters: Sensitivity-Aware Task Vectors for Many-Shot Multimodal In-Context Learning