mlsanityData to 7 Oct 2026

A Survey on Video Moment Localization

arXiv 2306.07515 ↗First posted 13 Jun 2023cs.CVcited by 18

Not on the map. Why?

Abstract (arXiv)

Video moment localization, also known as video moment retrieval, aiming to search a target segment within a video described by a given natural language query. Beyond the task of temporal action localization whereby the target actions are pre-defined, video moment retrieval can query arbitrary complex activities. In this survey paper, we aim to present a comprehensive review of existing video moment localization techniques, including supervised, weakly supervised, and unsupervised ones. We also review the datasets available for video moment localization and group results of related work. In addition, we discuss promising future directions for this field, in particular large-scale datasets and interpretable video moment localization models.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 73 of its 125 references that are in the map. First posted on arXiv 13 Jun 2023.

Builds on

73 of 125 references.

References · 73

  1. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  2. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  3. 2015Continuous control with deep reinforcement learningcited by 3,279
  4. 2015SSD: Single Shot MultiBox Detectorcited by 3,125
  5. 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 946
  6. 2017Dense-Captioning Events in Videoscited by 789
  7. 2017Localizing Moments in Video with Natural Languagecited by 660
  8. 2017TALL: Temporal Activity Localization via Language Querycited by 581
  9. 2016Hollywood in Homes: Crowdsourcing Data Collection for Activity Understandingcited by 535
  10. 2015Skip-Thought Vectorscited by 321
  11. 2019Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Languagecited by 283
  12. 2020Span-based Localizing Network for Natural Language Video Localizationcited by 234
38 more
  1. 2020Local-Global Video-Text Interactions for Temporal Groundingcited by 188
  2. 2015Weakly Supervised Deep Detection Networkscited by 183
  3. 2020Dense Regression Network for Video Groundingcited by 176
  4. 2017R-C3D: Region Convolutional 3D Network for Temporal Activity Detectioncited by 161
  5. 2018To Find Where You Talk: Temporal Sentence Localization in Video with Attention Based Location Regressioncited by 157
  6. 2018MAN: Moment Alignment Network for Natural Language Moment Retrieval via Iterative Graph Adjustmentcited by 145
  7. 2019Semantic Conditioned Dynamic Modulation for Temporal Sentence Grounding in Videoscited by 135
  8. 2017UntrimmedNets for Weakly Supervised Action Recognition and Detectioncited by 129
  9. 2018Multilevel Language and Vision Integration for Text-to-Clip Retrievalcited by 128
  10. 2015Natural Language Object Retrievalcited by 124
  11. 2017Single Shot Temporal Action Detectioncited by 123
  12. 2015Grounding of Textual Phrases in Images by Reconstructioncited by 112
  13. 2021Temporal Context Aggregation Network for Temporal Action Proposal Refinementcited by 111
  14. 2021Context-aware Biaffine Localizing Network for Temporal Sentence Groundingcited by 107
  15. 2021Interventional Video Grounding with Dual Contrastive Learningcited by 94
  16. 2021Boundary Proposal Network for Two-Stage Natural Language Video Localizationcited by 88
  17. 2019Weakly Supervised Video Moment Retrieval From Text Queriescited by 85
  18. 2018MAC: Mining Activity Concepts for Language-based Temporal Localizationcited by 84
  19. 2019Temporally Grounding Language Queries in Videos by Contextual Boundary-aware Predictioncited by 84
  20. 2021Deconfounded Video Moment Retrieval with Causal Interventioncited by 84
  21. 2018Localizing Moments in Video with Temporal Languagecited by 83
  22. 2019ExCL: Extractive Clip Localization Using Natural Language Descriptionscited by 82
  23. 2019Proposal-free Temporal Moment Localization of a Natural-Language Query in Video using Guided Attentioncited by 81
  24. 2019Cross-Modal Interaction Networks for Query-Based Moment Retrieval in Videoscited by 79
  25. 2020Revisiting Anchor Mechanisms for Temporal Action Localizationcited by 75
  26. 2020Jointly Cross- and Self-Modal Graph Attention Network for Query-Based Moment Localizationcited by 74
  27. 2018Diagnosing Error in Temporal Action Detectorscited by 71
  28. 2019Weakly-Supervised Video Moment Retrieval via Semantic Completion Networkcited by 69
  29. 2020BSN++: Complementary Boundary Regressor with Scale-Balanced Relation Modeling for Temporal Action Proposal Generationcited by 65
  30. 2019Read, Watch, and Move: Reinforcement Learning for Temporally Grounding Natural Language Descriptions in Videoscited by 60
  31. 2019Weakly-Supervised Spatio-Temporally Grounding Natural Sentence in Videocited by 60
  32. 2021Video Corpus Moment Retrieval with Contrastive Learningcited by 60
  33. 2020Uncovering Hidden Challenges in Query-Based Video Moment Retrievalcited by 58
  34. 2020Learning Modality Interaction for Temporal Sentence Localization and Event Captioning in Videoscited by 56
  35. 2021Natural Language Video Localization: A Revisit in Span-based Question Answering Frameworkcited by 55
  36. 2016Dynamic Coattention Networks For Question Answeringcited by 49
  37. 2020Tree-Structured Policy based Progressive Reinforcement Learning for Temporally Language Grounding in Videocited by 47
  38. 2021End-to-end Multi-modal Video Temporal Groundingcited by 47

50 most cited of 73 All 73 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 5; 2024: 6; 2025: 2; 2026: 5.

18 papers.

Sort:

By area:

  1. 2023Towards Surveillance Video-and-Language Understanding: New Dataset, Baselines, and Challengescited by 42
  2. 2023Correlation-Guided Query-Dependency Calibration for Video Temporal Groundingcited by 31
  3. 2024A Survey on Text-guided 3D Visual Grounding: Elements, Recent Advances, and Future Directionscited by 24
  4. 2023ViGT: Proposal-free Video Grounding with Learnable Token in Transformercited by 22
  5. 2023Dense Video Captioning: A Survey of Techniques, Datasets and Evaluation Protocolscited by 17
  6. 2025F3Set: Towards Analyzing Fast, Frequent, and Fine-grained Events from Videoscited by 7
  7. 2024Localizing Events in Videos with Multimodal Queriescited by 6
  8. 2026VideoTemp-o3: Harmonizing Temporal Grounding and Video Understanding in Agentic Thinking-with-Videoscited by 6
  9. 2024Do Vision-Language Transformers Exhibit Visual Commonsense? An Empirical Study of VCRcited by 4
  10. 2023Sample Less, Learn More: Efficient Action Recognition via Frame Feature Restorationcited by 2
  11. 20242DP-2MRC: 2-Dimensional Pointer-based Machine Reading Comprehension Method for Multimodal Moment Retrievalcited by 2
  12. 2025TIME: Temporal-Sensitive Multi-Dimensional Instruction Tuning and Robust Benchmarking for Video-LLMscited by 2
6 more
  1. 2024SketchQL Demonstration: Zero-shot Video Moment Querying with Sketchescited by 1
  2. 2024Human Stone Toolmaking Action Grammar (HSTAG): A Challenging Benchmark for Fine-grained Motor Behavior Recognitioncited by 0
  3. 2026GenSpan: Generation-Calibrated Motion Span Priors for Multi-Verb Video Corpus Moment Retrievalcited by 0
  4. 2026Understanding the Performance Plateau in Text-to-Video Retrieval: A Comprehensive Empirical and Linguistic Analysiscited by 0
  5. 2026Retrieving Any Relevant Moments: Benchmark and Models for Generalized Moment Retrievalcited by 0
  6. 2026Multi-proposal Collaboration and Multi-task Training for Weakly-supervised Video Moment Retrievalcited by 0