APoLLo: Unified Adapter and Prompt Learning for Vision Language Models