Goto

Collaborating Authors

 Large Language Model


One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos Zechen Bai 1 Tong He2 Haiyang Mei 1 Pichao Wang 2

Neural Information Processing Systems

We introduce VideoLISA, a video-based multimodal large language model designed to tackle the problem of language-instructed reasoning segmentation in videos. Leveraging the reasoning capabilities and world knowledge of large language models, and augmented by the Segment Anything Model, VideoLISA generates temporally consistent segmentation masks in videos based on language instructions.








Can Graph Learning Improve Planning in LLM-based Agents?

Neural Information Processing Systems

Task planning in language agents is emerging as an important research topic alongside the development of large language models (LLMs).