Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning