A Simple Yet Strong Baseline for Long-Term Conversational Memory of LLM Agents