GenDP: 3D Semantic Fields for Category-Level Generalizable Diffusion Policy