Retrieval-Augmented Dialogue Knowledge Aggregation for Expressive Conversational Speech Synthesis