Zero-shot World Models via Search in Memory