Do Large Language Models Dream of AI Agents?

What if AI could do the same? Bilt, a company that offers local shopping and restaurant deals to renters, recently deployed several million agents with the hopes of doing just that. Bilt uses technology from a startup called Letta that allows agents to learn from previous conversations and share memories with one another. Using a process called "sleeptime compute," the agents decide what information to store in its long-term memory vault and what might be needed for faster recall. "We can make a single update to a [memory] block and have the behavior of hundreds of thousands of agents change," says Andrew Fitz, an AI engineer at Bilt. "This is useful in any scenario where you want fine-grained control over agents' context," he adds, referring to the text prompt fed to the model at inference time.