mlsanityData to 7 Oct 2026

Localizing Moments in Video with Temporal Language

arXiv 1809.01337 ↗First posted 5 Sep 2018cs.CV cs.CLcited by 83

Not on the map. Why?

Abstract (arXiv)

Localizing moments in a longer video via natural language queries is a new, challenging task at the intersection of language and video understanding. Though moment localization with natural language is similar to other language and vision tasks like natural language object retrieval in images, moment localization offers an interesting opportunity to model temporal dependencies and reasoning in text. We propose a new model that explicitly reasons about different temporal segments in a video, and shows that temporal context is important for localizing phrases which include temporal language. To benchmark whether our model, and other recent video localization models, can effectively reason about temporal language, we collect the novel TEMPOral reasoning in video and language (TEMPO) dataset. Our dataset consists of two parts: a dataset with real videos and template sentences (TEMPO - Template Language) which allows for controlled studies on temporal language, and a human language dataset which consists of temporal sentences annotated by humans (TEMPO - Human Language).

Key facts. Cited by 83 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Sep 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 15; 2022: 18; 2023: 18; 2024: 15; 2025: 12; 2026: 5.

83 papers.

Sort:

By area:

  1. 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 352
  2. 2022Egocentric Video-Language Pretrainingcited by 231
  3. 2022Revisiting the "Video" in Video-Language Understandingcited by 167
  4. 2023EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbonecited by 130
  5. 2022TubeDETR: Spatio-Temporal Video Grounding with Transformerscited by 97
  6. 2021Interventional Video Grounding with Dual Contrastive Learningcited by 94
  7. 2021Boundary Proposal Network for Two-Stage Natural Language Video Localizationcited by 88
  8. 2024Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Modelscited by 87
  9. 2024TRACE: Temporal Grounding Video LLM via Causal Event Modelingcited by 87
  10. 2021Deconfounded Video Moment Retrieval with Causal Interventioncited by 84
  11. 2022CLIP-TSA: CLIP-Assisted Temporal Self-Attention for Weakly-Supervised Video Anomaly Detectioncited by 67
  12. 2023UnLoc: A Unified Framework for Video Localization Taskscited by 66
38 more
  1. 2024Evaluation of Text-to-Video Generation Models: A Dynamics Perspectivecited by 66
  2. 2021Video Corpus Moment Retrieval with Contrastive Learningcited by 60
  3. 2024TR-DETR: Task-Reciprocal Transformer for Joint Moment Retrieval and Highlight Detectioncited by 59
  4. 2021Natural Language Video Localization: A Revisit in Span-based Question Answering Frameworkcited by 55
  5. 2023VITATECS: A Diagnostic Dataset for Temporal Concept Understanding of Video-Language Modelscited by 55
  6. 2023Test of Time: Instilling Video-Language Models with a Sense of Timecited by 51
  7. 2024ReXTime: A Benchmark Suite for Reasoning-Across-Time in Videoscited by 51
  8. 2023CaptainCook4D: A Dataset for Understanding Errors in Procedural Activitiescited by 47
  9. 2023NaQ: Leveraging Narrations as Queries to Supervise Episodic Memorycited by 46
  10. 2022Multi-Modal Cross-Domain Alignment Network for Video Moment Retrievalcited by 43
  11. 2021A Closer Look at Temporal Sentence Grounding in Videos: Dataset and Metriccited by 42
  12. 2023VideoXum: Cross-modal Visual and Textural Summarization of Videoscited by 41
  13. 2023MH-DETR: Video Moment and Highlight Detection with Cross-modal Transformercited by 40
  14. 2021Cross-Sentence Temporal and Semantic Relations in Video Activity Localisationcited by 39
  15. 2023VidChapters-7M: Video Chapters at Scalecited by 39
  16. 2022Temporal Sentence Grounding in Videos: A Survey and Future Directionscited by 37
  17. 2021CONQUER: Contextual Query-aware Ranking for Video Corpus Moment Retrievalcited by 33
  18. 2023Correlation-Guided Query-Dependency Calibration for Video Temporal Groundingcited by 31
  19. 2021Embracing Uncertainty: Decoupling and De-bias for Robust Temporal Groundingcited by 29
  20. 2021A Survey on Temporal Sentence Grounding in Videoscited by 29
  21. 2023VideoCon: Robust Video-Language Alignment via Contrast Captionscited by 29
  22. 2021Natural Language Video Localization with Learnable Moment Proposalscited by 27
  23. 2022A Dataset for Medical Instructional Video Classification and Question Answeringcited by 26
  24. 2021Parallel Attention Network with Sequence Matching for Video Groundingcited by 22
  25. 2022Can Shuffling Video Benefit Temporal Bias Problem: A Novel Training Framework for Temporal Groundingcited by 22
  26. 2023Text-Visual Prompting for Efficient 2D Temporal Video Groundingcited by 18
  27. 2023A Survey on Video Moment Localizationcited by 18
  28. 2025Shot-by-Shot: Film-Grammar-Aware Training-Free Audio Description Generationcited by 13
  29. 2024Reversed in Time: A Novel Temporal-Emphasized Benchmark for Cross-Modal Video-Text Retrievalcited by 12
  30. 2021Towards Debiasing Temporal Sentence Grounding in Videocited by 11
  31. 2023DemaFormer: Damped Exponential Moving Average Transformer with Energy-Based Modeling for Temporal Language Groundingcited by 11
  32. 2025ZoomV: Temporal Zoom-in for Efficient Long Video Understandingcited by 10
  33. 2024A Survey of Video Datasets for Grounded Event Understandingcited by 9
  34. 2022Learning Sample Importance for Cross-Scenario Video Temporal Groundingcited by 8
  35. 2026Rethinking Weakly-supervised Video Temporal Grounding From a Game Perspectivecited by 8
  36. 2023Counterfactual Cross-modality Reasoning for Weakly Supervised Video Moment Localizationcited by 7
  37. 2021A Survey on Natural Language Video Localizationcited by 6
  38. 2022Contrastive Video-Language Learning with Fine-grained Frame Samplingcited by 6

50 most cited of 83 All 83 (JSON)