mlsanityData to 7 Oct 2026

Span-based Localizing Network for Natural Language Video Localization

arXiv 2004.13931 ↗First posted 29 Apr 2020cs.CL cs.CVcited by 234

Not on the map. Why?

Abstract (arXiv)

Given an untrimmed video and a text query, natural language video localization (NLVL) is to locate a matching span from the video that semantically corresponds to the query. Existing solutions formulate NLVL either as a ranking task and apply multimodal matching architecture, or as a regression task to directly regress the target video span. In this work, we address NLVL task with a span-based QA approach by treating the input video as text passage. We propose a video span localizing network (VSLNet), on top of the standard span-based QA framework, to address NLVL. The proposed VSLNet tackles the differences between NLVL and span-based QA through a simple yet effective query-guided highlighting (QGH) strategy. The QGH guides VSLNet to search for matching video span within a highlighted region. Through extensive experiments on three benchmark datasets, we show that the proposed VSLNet outperforms the state-of-the-art methods; and adopting span-based QA framework is a promising direction to solve NLVL.

Key facts. Cited by 234 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Apr 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 23; 2022: 37; 2023: 54; 2024: 54; 2025: 38; 2026: 28.

234 papers.

Sort:

By area:

  1. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  2. 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 253
  3. 2022Egocentric Video-Language Pretrainingcited by 231
  4. 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understandingcited by 224
  5. 2023UniVTG: Towards Unified Video-Language Temporal Groundingcited by 189
  6. 2023Query-Dependent Video Representation for Moment Retrieval and Highlight Detectioncited by 166
  7. 2023EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbonecited by 130
  8. 2021Sequence Parallelism: Long Sequence Training from System Perspectivecited by 125
  9. 2024Momentor: Advancing Video Large Language Model with Fine-Grained Temporal Reasoningcited by 122
  10. 2023VideoLLM: Modeling Video Sequence with Large Language Modelscited by 116
  11. 2024Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understandingcited by 106
  12. 2022Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understandingcited by 102
38 more
  1. 2022TubeDETR: Spatio-Temporal Video Grounding with Transformerscited by 97
  2. 2021Interventional Video Grounding with Dual Contrastive Learningcited by 94
  3. 2021Negative Sample Matters: A Renaissance of Metric Learning for Temporal Groundingcited by 90
  4. 2021Boundary Proposal Network for Two-Stage Natural Language Video Localizationcited by 88
  5. 2021Deconfounded Video Moment Retrieval with Causal Interventioncited by 84
  6. 2024HawkEye: Training Video-Text LLMs for Grounding Text in Videoscited by 83
  7. 2025T*: Re-thinking Temporal Search for Long-Form Video Understandingcited by 82
  8. 2024Frame-Voyager: Learning to Query Frames for Video Large Language Modelscited by 80
  9. 2023Knowing Where to Focus: Event-aware Transformer for Video Groundingcited by 79
  10. 2021QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queriescited by 72
  11. 2023UnLoc: A Unified Framework for Video Localization Taskscited by 66
  12. 2025V-STaR: Benchmarking Video-LLMs on Video Spatio-Temporal Reasoningcited by 66
  13. 2023Grounded Question-Answering in Long Egocentric Videoscited by 62
  14. 2021Video Corpus Moment Retrieval with Contrastive Learningcited by 60
  15. 2022Compositional Temporal Grounding with Structured Variational Cross-Graph Correspondence Learningcited by 59
  16. 2023MomentDiff: Generative Video Moment Retrieval from Random to Realcited by 58
  17. 2021Natural Language Video Localization: A Revisit in Span-based Question Answering Frameworkcited by 55
  18. 2021On Pursuit of Designing Multi-modal Transformer for Video Groundingcited by 54
  19. 2024ChatVTG: Video Temporal Grounding via Chat with Video Dialogue Large Language Modelscited by 54
  20. 2023LifelongMemory: Leveraging LLMs for Answering Queries in Long-form Egocentric Videoscited by 51
  21. 2024ReXTime: A Benchmark Suite for Reasoning-Across-Time in Videoscited by 51
  22. 2022InternVideo-Ego4D: A Pack of Champion Solutions to Ego4D Challengescited by 48
  23. 2022Memory-Guided Semantic Learning Network for Temporal Sentence Groundingcited by 46
  24. 2023NaQ: Leveraging Narrations as Queries to Supervise Episodic Memorycited by 46
  25. 2024EgoVideo: Exploring Egocentric Foundation Model and Downstream Adaptationcited by 44
  26. 2022Towards Visual-Prompt Temporal Answering Grounding in Medical Instructional Videocited by 43
  27. 2022Multi-Modal Cross-Domain Alignment Network for Video Moment Retrievalcited by 43
  28. 2021Adaptive Proposal Generation Network for Temporal Sentence Localization in Videoscited by 42
  29. 2023You Can Ground Earlier than See: An Effective and Efficient Pipeline for Temporal Sentence Grounding in Compressed Videoscited by 41
  30. 2025VideoMind: A Chain-of-LoRA Agent for Temporal-Grounded Video Reasoningcited by 41
  31. 2023MH-DETR: Video Moment and Highlight Detection with Cross-modal Transformercited by 40
  32. 2023VidChapters-7M: Video Chapters at Scalecited by 39
  33. 2022Hierarchical Local-Global Transformer for Temporal Sentence Groundingcited by 38
  34. 2022Temporal Sentence Grounding in Videos: A Survey and Future Directionscited by 37
  35. 2024SnAG: Scalable and Accurate Video Groundingcited by 36
  36. 2022Exploring Optical-Flow-Guided Motion and Detection-Based Appearance for Temporal Sentence Groundingcited by 35
  37. 2022Reducing the Vision and Language Bias for Temporal Sentence Groundingcited by 35
  38. 2024R2-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Groundingcited by 34

50 most cited of 234 All 234 (JSON)