Memory Is All You Need: Testing How Model Memory Affects LLM Performance in Annotation Tasks