mlsanityData to 7 Oct 2026

Local-Global Video-Text Interactions for Temporal Grounding

arXiv 2004.07514 ↗First posted 16 Apr 2020cs.CVcited by 188

Not on the map. Why?

Abstract (arXiv)

This paper addresses the problem of text-to-video temporal grounding, which aims to identify the time interval in a video semantically relevant to a text query. We tackle this problem using a novel regression-based model that learns to extract a collection of mid-level features for semantic phrases in a text query, which corresponds to important semantic entities described in the query (e.g., actors, objects, and actions), and reflect bi-modal interactions between the linguistic features of the query and the visual features of the video in multiple levels. The proposed method effectively predicts the target time interval by exploiting contextual information from local to global during bi-modal interactions. Through in-depth ablation studies, we find out that incorporating both local and global context in video and text interactions is crucial to the accurate grounding. Our experiment shows that the proposed method outperforms the state of the arts on Charades-STA and ActivityNet Captions datasets by large margins, 7.44% and 4.61% points at Recall@tIoU=0.5 metric, respectively. Code is available in https://github.com/JonghwanMun/LGI4temporalgrounding.

Key facts. Cited by 188 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Apr 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 29; 2022: 28; 2023: 45; 2024: 33; 2025: 30; 2026: 23.

188 papers.

Sort:

By area:

  1. 2023UniVTG: Towards Unified Video-Language Temporal Groundingcited by 189
  2. 2023EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbonecited by 130
  3. 2021Context-aware Biaffine Localizing Network for Temporal Sentence Groundingcited by 107
  4. 2021MAD: A Scalable Dataset for Language Grounding in Videos from Movie Audio Descriptionscited by 107
  5. 2022Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understandingcited by 102
  6. 2021Interventional Video Grounding with Dual Contrastive Learningcited by 94
  7. 2021Negative Sample Matters: A Renaissance of Metric Learning for Temporal Groundingcited by 90
  8. 2021Boundary Proposal Network for Two-Stage Natural Language Video Localizationcited by 88
  9. 2021Deconfounded Video Moment Retrieval with Causal Interventioncited by 84
  10. 2023Knowing Where to Focus: Event-aware Transformer for Video Groundingcited by 79
  11. 2023UnLoc: A Unified Framework for Video Localization Taskscited by 66
  12. 2021Video Corpus Moment Retrieval with Contrastive Learningcited by 60
38 more
  1. 2022Compositional Temporal Grounding with Structured Variational Cross-Graph Correspondence Learningcited by 59
  2. 2024TR-DETR: Task-Reciprocal Transformer for Joint Moment Retrieval and Highlight Detectioncited by 59
  3. 2023MomentDiff: Generative Video Moment Retrieval from Random to Realcited by 58
  4. 2021Natural Language Video Localization: A Revisit in Span-based Question Answering Frameworkcited by 55
  5. 2021On Pursuit of Designing Multi-modal Transformer for Video Groundingcited by 54
  6. 2021Neighbor-view Enhanced Model for Vision and Language Navigationcited by 50
  7. 2021End-to-end Multi-modal Video Temporal Groundingcited by 47
  8. 2023End-to-End Temporal Action Detection with 1B Parameters Across 1000 Framescited by 47
  9. 2022Memory-Guided Semantic Learning Network for Temporal Sentence Groundingcited by 46
  10. 2024Context-Guided Spatio-Temporal Video Groundingcited by 45
  11. 2021Adaptive Proposal Generation Network for Temporal Sentence Localization in Videoscited by 42
  12. 2023Towards Surveillance Video-and-Language Understanding: New Dataset, Baselines, and Challengescited by 42
  13. 2023You Can Ground Earlier than See: An Effective and Efficient Pipeline for Temporal Sentence Grounding in Compressed Videoscited by 41
  14. 2021Cross-Sentence Temporal and Semantic Relations in Video Activity Localisationcited by 39
  15. 2022Hierarchical Local-Global Transformer for Temporal Sentence Groundingcited by 38
  16. 2022Temporal Sentence Grounding in Videos: A Survey and Future Directionscited by 37
  17. 2024SnAG: Scalable and Accurate Video Groundingcited by 36
  18. 2022Exploring Optical-Flow-Guided Motion and Detection-Based Appearance for Temporal Sentence Groundingcited by 35
  19. 2022Reducing the Vision and Language Bias for Temporal Sentence Groundingcited by 35
  20. 2021Zero-shot Natural Language Video Localizationcited by 34
  21. 2023Towards Generalisable Video Moment Retrieval: Visual-Dynamic Injection to Image-Text Pre-Trainingcited by 32
  22. 2022Unsupervised Pre-training for Temporal Action Localization Taskscited by 31
  23. 2022Unsupervised Temporal Video Grounding with Deep Semantic Clusteringcited by 30
  24. 2021Embracing Uncertainty: Decoupling and De-bias for Robust Temporal Groundingcited by 29
  25. 2021A Survey on Temporal Sentence Grounding in Videoscited by 29
  26. 2023BAM-DETR: Boundary-Aligned Moment Detection Transformer for Temporal Sentence Grounding in Videoscited by 29
  27. 2021Support-Set Based Cross-Supervision for Video Groundingcited by 28
  28. 2023A Review of Deep Learning for Video Captioningcited by 28
  29. 2024Training-free Video Temporal Grounding using Large-scale Pre-trained Modelscited by 28
  30. 2021Natural Language Video Localization with Learnable Moment Proposalscited by 27
  31. 2023Towards Balanced Alignment: Modal-Enhanced Semantic Modeling for Video Moment Retrievalcited by 27
  32. 2024Task-Driven Exploration: Decoupling and Inter-Task Feedback for Joint Moment Retrieval and Highlight Detectioncited by 25
  33. 2022Exploring Motion and Appearance Information for Temporal Sentence Groundingcited by 24
  34. 2022Video Activity Localisation with Uncertainties in Temporal Boundarycited by 24
  35. 2023Localizing Moments in Long Video Via Multimodal Guidancecited by 23
  36. 2023Scanning Only Once: An End-to-end Framework for Fast Temporal Grounding in Long Videoscited by 23
  37. 2024FlashVTG: Feature Layering and Adaptive Score Handling Network for Video Temporal Groundingcited by 23
  38. 2021Parallel Attention Network with Sequence Matching for Video Groundingcited by 22

50 most cited of 188 All 188 (JSON)