Conversational Text Extraction with Large Language Models Using Retrieval-Augmented Systems