Leveraging Hallucinations to Reduce Manual Prompt Dependency in Promptable Segmentation