Enhancing Dialogue Annotation with Speaker Characteristics Leveraging a Frozen LLM