mlsanityData to 14 Oct 2026

DSE-VTG: Dual-Side Enhancement for Training-Free Video Temporal Grounding

arXiv 2609.08850 ↗First posted 8 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-guided Video Temporal Grounding (VTG) aims to localize the relevant segments in an untrimmed video based on text queries, yet collecting dense temporal annotations and training task-specific models remain costly and brittle under distribution shift. Recent training-free VTG approaches mitigate this issue by directly matching pretrained vision-language representations, but they still face two fundamental information bottlenecks: frame-wise visual encoding overlooks temporal dynamics, while fixed query embeddings cannot resolve query ambiguity. To address these issues, we propose DSE-VTG, a underlineDual-underlineSide underlineEnhancement framework that addresses both without any task-specific training. On the visual side, Multi-scale Similarity Fusion (MSF) combines frame- and clip-level similarities into a unified, temporally aware similarity profile. On the textual side, Query-level Test-Time Adaptation (Q-TTA) optimizes a lightweight additive offset to adapt the query embedding to the video at test time, without finetuning the backbone or calling external large language models. Extensive experiments on three standard and two OOD benchmarks show that DSE-VTG achieves state-of-the-art performance among training-free methods. On Charades-STA, it improves mIoU over the strongest prior training-free method by 5.61 points. Under distribution shift, DSE-VTG reaches 50.86 mIoU on Charades-CG Novel-Word, surpassing the strongest supervised baseline by 2.76 mIoU. Our code will be released upon acceptance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 51 references that are in the map. First posted on arXiv 8 Sep 2026.

Builds on

42 of 51 references.

References · 42

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2017TALL: Temporal Activity Localization via Language Querycited by 584
  6. 2016Hollywood in Homes: Crowdsourcing Data Collection for Activity Understandingcited by 537
  7. 2022InternVideo: General Video Foundation Models via Generative and Discriminative Learningcited by 447
  8. 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 406
  9. 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 255
  10. 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 230
  11. 2023UniVTG: Towards Unified Video-Language Temporal Groundingcited by 190
  12. 2023Query-Dependent Video Representation for Moment Retrieval and Highlight Detectioncited by 166
30 more
  1. 2022UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detectioncited by 148
  2. 2019Semantic Conditioned Dynamic Modulation for Temporal Sentence Grounding in Videoscited by 135
  3. 2025VLM2Vec-V2: Advancing Multimodal Embedding for Videos, Images, and Visual Documentscited by 116
  4. 2023Knowing Where to Focus: Event-aware Transformer for Video Groundingcited by 79
  5. 2022Compositional Temporal Grounding with Structured Variational Cross-Graph Correspondence Learningcited by 59
  6. 2024TR-DETR: Task-Reciprocal Transformer for Joint Moment Retrieval and Highlight Detectioncited by 59
  7. 2018Weakly Supervised Dense Event Captioning in Videoscited by 58
  8. 2022Memory-Guided Semantic Learning Network for Temporal Sentence Groundingcited by 46
  9. 2021A Closer Look at Temporal Sentence Grounding in Videos: Dataset and Metriccited by 42
  10. 2021Cross-Sentence Temporal and Semantic Relations in Video Activity Localisationcited by 39
  11. 2021Zero-shot Natural Language Video Localizationcited by 34
  12. 2024R2-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Groundingcited by 34
  13. 2025RzenEmbed: Towards Comprehensive Multimodal Retrievalcited by 29
  14. 2024Training-free Video Temporal Grounding using Large-scale Pre-trained Modelscited by 28
  15. 2023Towards Balanced Alignment: Modal-Enhanced Semantic Modeling for Video Moment Retrievalcited by 27
  16. 2022Video Activity Localisation with Uncertainties in Temporal Boundarycited by 24
  17. 2024FlashVTG: Feature Layering and Adaptive Score Handling Network for Video Temporal Groundingcited by 23
  18. 2022Language-free Training for Zero-shot Video Groundingcited by 22
  19. 2023Zero-Shot Video Moment Retrieval from Frozen Vision-Language Modelscited by 22
  20. 2024VTG-GPT: Tuning-Free Zero-Shot Video Temporal Grounding with GPTcited by 19
  21. 2024Test-Time Zero-Shot Temporal Action Localizationcited by 19
  22. 2025Omni-Embed-Nemotron: A Unified Multimodal Retrieval Model for Text, Image, Audio, and Videocited by 16
  23. 2023Gaussian Mixture Proposals with Pull-Push Learning Scheme to Capture Diverse Events for Weakly Supervised Temporal Video Groundingcited by 10
  24. 2025TAG: A Simple Yet Effective Temporal-Aware Approach for Zero-Shot Video Temporal Groundingcited by 7
  25. 2025Empower Words: DualGround for Structured Phrase and Sentence-Level Temporal Groundingcited by 4
  26. 2025Adaptive Evidential Learning for Temporal-Semantic Robustness in Moment Retrievalcited by 4
  27. 2024SHINE: Saliency-aware HIerarchical NEgative Ranking for Compositional Temporal Groundingcited by 3
  28. 2025Boosting Temporal Sentence Grounding via Causal Inferencecited by 3
  29. 2025When One Moment Isn't Enough: Multi-Moment Retrieval with Cross-Moment Interactionscited by 3
  30. 2025AdaRewriter: Unleashing the Power of Prompting-based Conversational Query Reformulation via Test-Time Adaptationcited by 2

Built on by

Not cited yet.