GraphAdapter: Tuning Vision-Language Models With Dual Knowledge Graph