Negative Yields Positive: Unified Dual-Path Adapter for Vision-Language Models