mlsanityData to 7 Oct 2026

Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Language

arXiv 1912.03590 ↗First posted 8 Dec 2019cs.CV cs.IR cs.MMcited by 283

Not on the map. Why?

Abstract (arXiv)

We address the problem of retrieving a specific moment from an untrimmed video by a query sentence. This is a challenging problem because a target moment may take place in relations to other temporal moments in the untrimmed video. Existing methods cannot tackle this challenge well since they consider temporal moments individually and neglect the temporal dependencies. In this paper, we model the temporal relations between video moments by a two-dimensional map, where one dimension indicates the starting time of a moment and the other indicates the end time. This 2D temporal map can cover diverse video moments with different lengths, while representing their adjacent relations. Based on the 2D map, we propose a Temporal Adjacent Network (2D-TAN), a single-shot framework for moment localization. It is capable of encoding the adjacent temporal relation, while learning discriminative features for matching video moments with referring expressions. We evaluate the proposed 2D-TAN on three challenging benchmarks, i.e., Charades-STA, ActivityNet Captions, and TACoS, where our 2D-TAN outperforms the state-of-the-art.

Key facts. Cited by 283 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Dec 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 38; 2022: 49; 2023: 60; 2024: 49; 2025: 49; 2026: 38.

283 papers.

Sort:

By area:

  1. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  2. 2022Egocentric Video-Language Pretrainingcited by 231
  3. 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understandingcited by 224
  4. 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingcited by 212
  5. 2023UniVTG: Towards Unified Video-Language Temporal Groundingcited by 189
  6. 2023Query-Dependent Video Representation for Moment Retrieval and Highlight Detectioncited by 166
  7. 2022UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detectioncited by 148
  8. 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
  9. 2024Momentor: Advancing Video Large Language Model with Fine-Grained Temporal Reasoningcited by 122
  10. 2021Relaxed Transformer Decoders for Direct Action Proposal Generationcited by 116
  11. 2021Context-aware Biaffine Localizing Network for Temporal Sentence Groundingcited by 107
  12. 2021MAD: A Scalable Dataset for Language Grounding in Videos from Movie Audio Descriptionscited by 107
38 more
  1. 2022TubeDETR: Spatio-Temporal Video Grounding with Transformerscited by 97
  2. 2021Interventional Video Grounding with Dual Contrastive Learningcited by 94
  3. 2021Negative Sample Matters: A Renaissance of Metric Learning for Temporal Groundingcited by 90
  4. 2021Boundary Proposal Network for Two-Stage Natural Language Video Localizationcited by 88
  5. 2021Deconfounded Video Moment Retrieval with Causal Interventioncited by 84
  6. 2024HawkEye: Training Video-Text LLMs for Grounding Text in Videoscited by 83
  7. 2023Knowing Where to Focus: Event-aware Transformer for Video Groundingcited by 79
  8. 2021QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queriescited by 72
  9. 2024TimeMarker: A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Abilitycited by 69
  10. 2023UnLoc: A Unified Framework for Video Localization Taskscited by 66
  11. 2025V-STaR: Benchmarking Video-LLMs on Video Spatio-Temporal Reasoningcited by 66
  12. 2021Video Corpus Moment Retrieval with Contrastive Learningcited by 60
  13. 2022Compositional Temporal Grounding with Structured Variational Cross-Graph Correspondence Learningcited by 59
  14. 2024TR-DETR: Task-Reciprocal Transformer for Joint Moment Retrieval and Highlight Detectioncited by 59
  15. 2023MomentDiff: Generative Video Moment Retrieval from Random to Realcited by 58
  16. 2021Natural Language Video Localization: A Revisit in Span-based Question Answering Frameworkcited by 55
  17. 2021On Pursuit of Designing Multi-modal Transformer for Video Groundingcited by 54
  18. 2024ChatVTG: Video Temporal Grounding via Chat with Video Dialogue Large Language Modelscited by 54
  19. 2023LifelongMemory: Leveraging LLMs for Answering Queries in Long-form Egocentric Videoscited by 51
  20. 2024ReXTime: A Benchmark Suite for Reasoning-Across-Time in Videoscited by 51
  21. 2022Memory-Guided Semantic Learning Network for Temporal Sentence Groundingcited by 46
  22. 2023NaQ: Leveraging Narrations as Queries to Supervise Episodic Memorycited by 46
  23. 2022LocVTP: Video-Text Pre-training for Temporal Localizationcited by 44
  24. 2022Towards Visual-Prompt Temporal Answering Grounding in Medical Instructional Videocited by 43
  25. 2022Multi-Modal Cross-Domain Alignment Network for Video Moment Retrievalcited by 43
  26. 2021A Closer Look at Temporal Sentence Grounding in Videos: Dataset and Metriccited by 42
  27. 2021Adaptive Proposal Generation Network for Temporal Sentence Localization in Videoscited by 42
  28. 2023Towards Surveillance Video-and-Language Understanding: New Dataset, Baselines, and Challengescited by 42
  29. 2023You Can Ground Earlier than See: An Effective and Efficient Pipeline for Temporal Sentence Grounding in Compressed Videoscited by 41
  30. 2025VideoMind: A Chain-of-LoRA Agent for Temporal-Grounded Video Reasoningcited by 41
  31. 2023MH-DETR: Video Moment and Highlight Detection with Cross-modal Transformercited by 40
  32. 2021Cross-Sentence Temporal and Semantic Relations in Video Activity Localisationcited by 39
  33. 2023VidChapters-7M: Video Chapters at Scalecited by 39
  34. 2022Hierarchical Local-Global Transformer for Temporal Sentence Groundingcited by 38
  35. 2021Weakly Supervised Temporal Adjacent Network for Language Groundingcited by 37
  36. 2022Temporal Sentence Grounding in Videos: A Survey and Future Directionscited by 37
  37. 2024SnAG: Scalable and Accurate Video Groundingcited by 36
  38. 2022Exploring Optical-Flow-Guided Motion and Detection-Based Appearance for Temporal Sentence Groundingcited by 35

50 most cited of 283 All 283 (JSON)