GRIM: Task-Oriented Grasping with Conditioning on Generative Examples