mlsanityData to 7 Oct 2026

ChatVTG: Video Temporal Grounding via Chat with Video Dialogue Large Language Models

arXiv 2410.12813 ↗First posted 1 Oct 2024cs.MM cs.CVcited by 54

Not on the map. Why?

Cited by 22 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Video Temporal Grounding (VTG) aims to ground specific segments within an untrimmed video corresponding to the given natural language query. Existing VTG methods largely depend on supervised learning and extensive annotated data, which is labor-intensive and prone to human biases. To address these challenges, we present ChatVTG, a novel approach that utilizes Video Dialogue Large Language Models (LLMs) for zero-shot video temporal grounding. Our ChatVTG leverages Video Dialogue LLMs to generate multi-granularity segment captions and matches these captions with the given query for coarse temporal grounding, circumventing the need for paired annotation data. Furthermore, to obtain more precise temporal grounding results, we employ moment refinement for fine-grained caption proposals. Extensive experiments on three mainstream VTG datasets, including Charades-STA, ActivityNet-Captions, and TACoS, demonstrate the effectiveness of ChatVTG. Our ChatVTG surpasses the performance of current zero-shot methods.

Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). Builds on 29 of its 40 references that are in the map. First posted on arXiv 1 Oct 2024.

Builds on

29 of 40 references.

References · 29

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2023Visual Instruction Tuningcited by 7,792
  5. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  6. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
  7. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
  8. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
  9. 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 811
  10. 2017Dense-Captioning Events in Videoscited by 789
  11. 2017TALL: Temporal Activity Localization via Language Querycited by 581
  12. 2016Hollywood in Homes: Crowdsourcing Data Collection for Activity Understandingcited by 535
17 more
  1. 2019Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Languagecited by 283
  2. 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 253
  3. 2020Span-based Localizing Network for Natural Language Video Localizationcited by 234
  4. 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 232
  5. 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 225
  6. 2023UniVTG: Towards Unified Video-Language Temporal Groundingcited by 189
  7. 2021Negative Sample Matters: A Renaissance of Metric Learning for Temporal Groundingcited by 90
  8. 2019Weakly Supervised Video Moment Retrieval From Text Queriescited by 85
  9. 2023CTVIS: Consistent Training for Online Video Instance Segmentationcited by 50
  10. 2023PG-Video-LLaVA: Pixel Grounding Large Video-Language Modelscited by 50
  11. 2021Cross-Sentence Temporal and Semantic Relations in Video Activity Localisationcited by 39
  12. 2021Zero-shot Natural Language Video Localizationcited by 34
  13. 2023Towards Generalisable Video Moment Retrieval: Visual-Dynamic Injection to Image-Text Pre-Trainingcited by 32
  14. 2022Unsupervised Temporal Video Grounding with Deep Semantic Clusteringcited by 30
  15. 2022Language-free Training for Zero-shot Video Groundingcited by 22
  16. 2023LLM4VG: Large Language Models Evaluation for Video Groundingcited by 8
  17. 2022Part-level Action Parsing via a Pose-guided Coarse-to-Fine Frameworkcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 7; 2025: 26; 2026: 21.

54 papers.

Sort:

By area:

  1. 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 203
  2. 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
  3. 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 127
  4. 2024TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuningcited by 99
  5. 2024TimeMarker: A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Abilitycited by 69
  6. 2025VideoWorld: Exploring Knowledge Learning from Unlabeled Videoscited by 42
  7. 2025VideoMind: A Chain-of-LoRA Agent for Temporal-Grounded Video Reasoningcited by 41
  8. 2024Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignmentcited by 29
  9. 2025MotionPro: A Precise Motion Controller for Image-to-Video Generationcited by 29
  10. 2026LVOmniBench: Pioneering Long Audio-Video Understanding Evaluation for Omnimodal LLMscited by 22
  11. 2025A Survey on Video Temporal Grounding with Multimodal Large Language Modelcited by 19
  12. 2024ReVisionLLM: Recursive Vision-Language Model for Temporal Grounding in Hour-Long Videoscited by 18
38 more
  1. 2025Are They the Same? Exploring Visual Correspondence Shortcomings of Multimodal LLMscited by 16
  2. 2024TimeRefine: Temporal Grounding with Time Refining Video LLMcited by 15
  3. 2026AURA: Always-On Understanding and Real-Time Assistance via Video Streamscited by 15
  4. 2025Shot-by-Shot: Film-Grammar-Aware Training-Free Audio Description Generationcited by 13
  5. 2025TEMPURA: Temporal Event Masked Prediction and Understanding for Reasoning in Actioncited by 13
  6. 2025Active Perception Agent for Omnimodal Audio-Video Understandingcited by 13
  7. 2025Enrich and Detect: Video Temporal Grounding with Multimodal LLMscited by 12
  8. 2025Object-Shot Enhanced Grounding Network for Egocentric Videocited by 11
  9. 2025DisTime: Distribution-based Time Representation for Video Large Language Modelscited by 7
  10. 2025VideoTG-R1: Boosting Video Temporal Grounding via Curriculum Reinforcement Learning on Reflected Boundary Annotationscited by 7
  11. 2025TempR1: Improving Temporal Understanding of MLLMs via Temporal-Aware Multi-Task Reinforcement Learningcited by 7
  12. 2026VideoTemp-o3: Harmonizing Temporal Grounding and Video Understanding in Agentic Thinking-with-Videoscited by 6
  13. 2025MUPA: Towards Multi-Path Agentic Reasoning for Grounded Video Question Answeringcited by 4
  14. 2026VeRVE: Versatile Retrieval for Videos via Unified Embeddingscited by 4
  15. 2026OmniVTG: A Large-Scale Dataset and Training Paradigm for Open-World Video Temporal Groundingcited by 4
  16. 2025Video-in-the-Loop: Span-Grounded Long Video QA with Interleaved Reasoningcited by 3
  17. 2025SVAG-Bench: A Large-Scale Benchmark for Multi-Instance Spatio-temporal Video Action Groundingcited by 3
  18. 2026Keeping the Evidence Chain: Semantic Evidence Allocation for Training-Free Token Pruning in Video Temporal Groundingcited by 3
  19. 2026Harnessing Streaming Video in the Wildcited by 3
  20. 2026Temporal-Aware Reasoning Optimization for Video Temporal Groundingcited by 3
  21. 2024T-SVG: Text-Driven Stereoscopic Video Generationcited by 2
  22. 2025Ask2Loc: Learning to Locate Instructional Visual Answers by Asking Questionscited by 2
  23. 2025Empowering Multimodal LLMs with External Tools: A Comprehensive Surveycited by 2
  24. 2025Learning to Refuse: Refusal-Aware Reinforcement Fine-Tuning for Hard-Irrelevant Queries in Video Temporal Groundingcited by 2
  25. 2025What Happens When: Learning Temporal Orders of Events in Videoscited by 2
  26. 2025UFVideo: Towards Unified Fine-Grained Video Cooperative Understanding with Large Language Modelscited by 2
  27. 2024Grounding is All You Need? Dual Temporal Grounding for Video Dialogcited by 1
  28. 2026E.M.Ground: A Temporal Grounding Vid-LLM with Holistic Event Perception and Matchingcited by 1
  29. 2026T2SGrid: Temporal-to-Spatial Gridification for Video Temporal Groundingcited by 1
  30. 2026GroundVTS: Visual Token Sampling in Multimodal Large Language Models for Video Temporal Groundingcited by 1
  31. 2026Be Indiscrete: The Benefits of Learning Continuous Spine Degeneration Severity Scorescited by 1
  32. 2025DaMO: A Data-Efficient Multimodal Orchestrator for Temporal Reasoning with Video LLMscited by 0
  33. 2025OVG-HQ: Online Video Grounding with Hybrid-modal Queriescited by 0
  34. 2026Interactive Episodic Memory with User Feedbackcited by 0
  35. 2026MMVIAD: Multi-view Multi-task Video Understanding for Industrial Anomaly Detectioncited by 0
  36. 2026MLLMs Know When Before Speaking: Revealing and Recovering Temporal Grounding via Attention Cuescited by 0
  37. 2026DRIFT: A Residual Flow Adapter for Decoding Continuous Outputs in Vision-Language Modelscited by 0
  38. 2026Conditional Multi-Event Temporal Grounding in Long-Form Videocited by 0

50 most cited of 54 All 54 (JSON)