Needle in the Haystack for Memory Based Large Language Models