3D-Mem: 3D Scene Memory for Embodied Exploration and Reasoning