On the Structural Memory of LLM Agents