Memory Assisted LLM for Personalized Recommendation System