HiLight: Technical Report on the Motern AI Video Language Model

A recent line of MLLMs work[1, 2] has started to explore introducing video modality. On the one hand, video contains more information than images because of the time-dimensional modelling capability, and video is much better in capturing events. On the other hand video cameras are everywhere around us as a common and low-cost electronic surveillance tool. However, how to transform advanced academic results or models into beneficial and practical products is a subject of much greater concern to industry. According to business requirement of the company, our team will focus on a challenging task, video understanding of billiards indoor scenes. We propose HiLight, a video chat model. HiLight is constructed by the two stages, each of which is required to accomplish respective target performance: 1. Video and Text Modality Alignment Stage: This stage requires aligning the video modality with the text modality as well as a strong ability to detecting small objects.