Ab Initio Particle-based Object Manipulation