AnchorDP3: 3D Affordance Guided Sparse Diffusion Policy for Robotic Manipulation