HACMan++: Spatially-Grounded Motion Primitives for Manipulation