mlsanityData to 14 Oct 2026

Number it: Temporal Grounding Videos like Flipping Manga

arXiv 2411.10332 ↗First posted 15 Nov 2024cs.CVcited by 65

Not on the map. Why?

Cited by 23 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Video Large Language Models (Vid-LLMs) have made remarkable advancements in comprehending video content for QA dialogue. However, they struggle to extend this visual understanding to tasks requiring precise temporal localization, known as Video Temporal Grounding (VTG). To address this gap, we introduce Number-Prompt (NumPro), a novel method that empowers Vid-LLMs to bridge visual comprehension with temporal grounding by adding unique numerical identifiers to each video frame. Treating a video as a sequence of numbered frame images, NumPro transforms VTG into an intuitive process: flipping through manga panels in sequence. This allows Vid-LLMs to "read" event timelines, accurately linking visual content with corresponding temporal information. Our experiments demonstrate that NumPro significantly boosts VTG performance of top-tier Vid-LLMs without additional computational cost. Furthermore, fine-tuning on a NumPro-enhanced dataset defines a new state-of-the-art for VTG, surpassing previous top-performing methods by up to 6.9% in mIoU for moment retrieval and 8.5% in mAP for highlight detection. The code will be available at https://github.com/yongliang-wu/NumPro.

Key facts. Cited by 65 papers in the map (data through 14 Oct 2026). Builds on 69 of its 88 references that are in the map. First posted on arXiv 15 Nov 2024.

Builds on

69 of 88 references.

References · 69

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  7. 2023Qwen Technical Reportcited by 3,344
  8. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  9. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  10. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
  11. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
  12. 2017Dense-Captioning Events in Videoscited by 793
38 more
  1. 2017TALL: Temporal Activity Localization via Language Querycited by 584
  2. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
  3. 2024Long Context Transfer from Language to Visioncited by 515
  4. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
  5. 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 406
  6. 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 299
  7. 2017Temporal Segment Networks for Action Recognition in Videoscited by 279
  8. 2017Temporal Action Detection with Structured Segment Networkscited by 267
  9. 2023Vid2Seq: Large-Scale Pretraining of a Visual Language Model for Dense Video Captioningcited by 263
  10. 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 255
  11. 2023What does CLIP know about a red circle? Visual prompt engineering for VLMscited by 218
  12. 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 217
  13. 2023UniVTG: Towards Unified Video-Language Temporal Groundingcited by 190
  14. 2021CPT: Colorful Prompt Tuning for Pre-trained Vision-Language Modelscited by 183
  15. 2020TEA: Temporal Excitation and Aggregation for Action Recognitioncited by 165
  16. 2023ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Promptscited by 161
  17. 2024Momentor: Advancing Video Large Language Model with Fine-Grained Temporal Reasoningcited by 122
  18. 2024Groma: Localized Visual Tokenization for Grounding Multimodal Large Language Modelscited by 119
  19. 2024GroundingGPT:Language Enhanced Multi-modal Grounding Modelcited by 101
  20. 2021Interventional Video Grounding with Dual Contrastive Learningcited by 94
  21. 2024Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Modelscited by 91
  22. 2024TRACE: Temporal Grounding Video LLM via Causal Event Modelingcited by 89
  23. 2024HawkEye: Training Video-Text LLMs for Grounding Text in Videoscited by 86
  24. 2019Weakly Supervised Video Moment Retrieval From Text Queriescited by 85
  25. 2024VTG-LLM: Integrating Timestamp Knowledge into Video LLMs for Enhanced Video Temporal Groundingcited by 85
  26. 2021SUTD-TrafficQA: A Question Answering Benchmark and an Efficient Network for Video Reasoning over Traffic Eventscited by 84
  27. 2023Hierarchical Video-Moment Retrieval and Step-Captioningcited by 83
  28. 2023Exploring Diverse In-Context Configurations for Image Captioningcited by 63
  29. 2023Generalized Video Anomaly Event Detection: Systematic Taxonomy and Comparison of Deep Modelscited by 59
  30. 2022Image-text Retrieval: A Survey on Recent Research and Developmentcited by 55
  31. 2023RaSa: Relation and Sensitivity Aware Representation Learning for Text-based Person Searchcited by 54
  32. 2024Visual Prompting in Multimodal Large Language Models: A Surveycited by 54
  33. 2023Multi-modal In-Context Learning Makes an Ego-evolving Scene Text Recognizercited by 53
  34. 2024MineDreamer: Learning to Follow Instructions via Chain-of-Imagination for Simulated-World Controlcited by 53
  35. 2021End-to-end Multi-modal Video Temporal Groundingcited by 47
  36. 2024DetToolChain: A New Prompting Paradigm to Unleash Detection Ability of MLLMcited by 46
  37. 2024Add-it: Training-Free Object Insertion in Images With Pretrained Diffusion Modelscited by 43
  38. 2021Learning Semantic-Aligned Feature Representation for Text-based Person Searchcited by 40

50 most cited of 69 All 69 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 30; 2026: 33.

65 papers.

Sort:

By area:

  1. 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 146
  2. 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoningcited by 91
  3. 2025LLaVA-ST: A Multimodal Large Language Model for Fine-Grained Spatial-Temporal Understandingcited by 59
  4. 2025OmniVideoBench: Towards Audio-Visual Understanding Evaluation for Omni MLLMscited by 59
  5. 2025Generative Frame Sampler for Long Video Understandingcited by 37
  6. 2026Video-OPD: Efficient Post-Training of Multimodal Large Language Models for Temporal Video Grounding via On-Policy Distillationcited by 36
  7. 2024Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Surveycited by 27
  8. 2025FrameMind: Frame-Interleaved Video Reasoning via Reinforcement Learningcited by 21
  9. 2025A Survey on Video Temporal Grounding with Multimodal Large Language Modelcited by 20
  10. 2025RSVP: Reasoning Segmentation via Visual Prompting and Multi-modal Chain-of-Thoughtcited by 19
  11. 2025Shot-by-Shot: Film-Grammar-Aware Training-Free Audio Description Generationcited by 13
  12. 2026EventMemAgent: Hierarchical Event-Centric Memory for Online Video Understanding with Adaptive Tool Usecited by 12
38 more
  1. 2025ViaRL: Adaptive Temporal Grounding via Visual Iterated Amplification Reinforcement Learningcited by 11
  2. 2025VideoNSA: Native Sparse Attention Scales Video Understandingcited by 11
  3. 2025K-frames: Scene-Driven Any-k Keyframe Selection for long video understandingcited by 11
  4. 2024Video Repurposing from User Generated Content: A Large-scale Dataset and Benchmarkcited by 9
  5. 2026Uni-Skill: Building Self-Evolving Skill Repository for Generalizable Robotic Manipulationcited by 9
  6. 2025VideoPASTA: 7K Preference Pairs That Matter for Video-LLM Alignmentcited by 8
  7. 2025TOGA: Temporally Grounded Open-Ended Video QA with Weak Supervisioncited by 8
  8. 2025Watch and Listen: Understanding Audio-Visual-Speech Moments with Multimodal LLMcited by 7
  9. 2025VReST: Enhancing Reasoning in Large Vision-Language Models through Tree Search and Self-Reward Mechanismcited by 7
  10. 2025VideoTG-R1: Boosting Video Temporal Grounding via Curriculum Reinforcement Learning on Reflected Boundary Annotationscited by 7
  11. 2025UniComp: Rethinking Video Compression Through Informational Uniquenesscited by 7
  12. 2026Look Carefully: Adaptive Visual Reinforcements in Multimodal Large Language Models for Hallucination Mitigationcited by 7
  13. 2025SafePLUG: Empowering Multimodal LLMs with Pixel-Level Insight and Temporal Grounding for Traffic Accident Understandingcited by 6
  14. 2025Strefer: Empowering Video LLMs with Space-Time Referring and Reasoning via Synthetic Instruction Datacited by 6
  15. 2025Video Panels for Long Video Understandingcited by 6
  16. 2026VideoLoom: A Video Large Language Model for Joint Spatial-Temporal Understandingcited by 5
  17. 2025Rethinking Byzantine Robustness in Federated Recommendation from Sparse Aggregation Perspectivecited by 4
  18. 2025LeAdQA: LLM-Driven Context-Aware Temporal Grounding for Video Question Answeringcited by 4
  19. 2025MomentSeg: Moment-Centric Sampling for Enhanced Video Pixel Understandingcited by 4
  20. 2026VisionCoach: Reinforcing Grounded Video Reasoning via Visual-Perception Promptingcited by 4
  21. 2026ViKey: Enhancing Temporal Understanding in Videos via Visual Promptingcited by 3
  22. 2026OmniReasoner: Thinking with Long Audio-Video via Native Tool Usecited by 3
  23. 2025Measure Twice, Cut Once: A Semantic-Oriented Approach to Video Temporal Localization with Video LLMscited by 2
  24. 2025Image-to-Video Transfer Learning based on Image-Language Foundation Models: A Comprehensive Surveycited by 2
  25. 2025From Segments to Scenes: Temporal Understanding for Agentic Autonomous Driving via Vision-Language Modelscited by 2
  26. 2026Graph-to-Frame RAG: Visual-Space Knowledge Fusion for Training-Free and Auditable Video Reasoningcited by 2
  27. 2026Evidence-Backed Video Question Answeringcited by 2
  28. 2025Invert4TVG: A Temporal Video Grounding Framework with Inversion Tasks Preserving Action Understanding Abilitycited by 1
  29. 2026See More, Store Less: Memory-Efficient Resolution for Video Moment Retrievalcited by 1
  30. 2026E.M.Ground: A Temporal Grounding Vid-LLM with Holistic Event Perception and Matchingcited by 1
  31. 2026GuardAlign: Test-time Safety Alignment in Multimodal Large Language Modelscited by 1
  32. 2026Imagine How To Change: Explicit Procedure Modeling for Change Captioningcited by 1
  33. 2026T2SGrid: Temporal-to-Spatial Gridification for Video Temporal Groundingcited by 1
  34. 2026GroundVTS: Visual Token Sampling in Multimodal Large Language Models for Video Temporal Groundingcited by 1
  35. 2026ActivityForensics: A Comprehensive Benchmark for Localizing Manipulated Activity in Videoscited by 1
  36. 2026STORM: End-to-End Referring Multi-Object Tracking in Videoscited by 1
  37. 2026Towards Fine-grained Temporal Perception: Post-Training Large Audio-Language Models with Audio-Side Time Promptcited by 1
  38. 2026Towards Temporal Compositional Reasoning in Long-Form Sports Videoscited by 1

50 most cited of 65 All 65 (JSON)