Neural Grasp Distance Fields for Robot Manipulation