mlsanityData to 14 Oct 2026

HiLight: Technical Report on the Motern AI Video Language Model

arXiv 2407.07325 ↗First posted 10 Jul 2024cs.CV cs.CL cs.MMcited by 1

Not on the map. Why?

Abstract (arXiv)

This technical report presents the implementation of a state-of-the-art video encoder for video-text modal alignment and a video conversation framework called HiLight, which features dual visual towers. The work is divided into two main parts: 1.alignment of video and text modalities; 2.convenient and efficient way to interact with users. Our goal is to address the task of video comprehension in the context of billiards. The report includes a discussion of the concepts and the final solution developed during the task's implementation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 10 of its 12 references that are in the map. First posted on arXiv 10 Jul 2024.

Builds on

10 of 12 references.

References · 10

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
  5. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
  6. 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 365
  7. 2024Long-CLIP: Unlocking the Long-Text Capability of CLIPcited by 300
  8. 2024VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understandingcited by 115
  9. 2024Ferret-v2: An Improved Baseline for Referring and Grounding with Large Language Modelscited by 97
  10. 2024Improving fine-grained understanding in image-text pre-trainingcited by 44

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.