Decoupling Knowledge from Memorization: Retrieval-augmented Prompt Learning