LLM as A Robotic Brain: Unifying Egocentric Memory and Control