PALM: Few-Shot Prompt Learning for Audio Language Models