TimeZero: Temporal Video Grounding with Reasoning-Guided LVLM

Wang, Ye, Xu, Boshen, Yue, Zihao, Xiao, Zihan, Wang, Ziheng, Zhang, Liang, Yang, Dingyi, Wang, Wenxuan, Jin, Qin

arXiv.org Artificial Intelligence 

We introduce TimeZero, a reasoning-guided LVLM designed for the temporal video grounding (TVG) task. This task requires precisely localizing relevant video segments within long videos based on a given language query. TimeZero tackles this challenge by extending the inference process, enabling the model to reason about video-language relationships solely through reinforcement learning. To evaluate the effectiveness of TimeZero, we conduct experiments on two benchmarks, where TimeZero achieves state-of-the-art performance on Charades-STA. Code is available at https://github.com/www-Ye/TimeZero.