SPIDR: SDF-based Neural Point Fields for Illumination and Deformation