mlsanityData to 7 Oct 2026

GenSpan: Generation-Calibrated Motion Span Priors for Multi-Verb Video Corpus Moment Retrieval

arXiv 2603.22121 ↗First posted 23 Mar 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Video Corpus Moment Retrieval (VCMR) aims to retrieve both the correct video and its temporal segment corresponding to a natural-language query, a task that is especially challenging for multi-verb queries where temporal action ordering is critical. Existing approaches often rely solely on text or static images and struggle to capture implicit motion dynamics, leading to retrieval errors and temporal misalignment. We propose GenSpan, a generation-calibrated VCMR framework that constructs short auxiliary videos from LLM-selected subtitle cues and decomposed sub-events, using these as temporal priors rather than direct retrieval targets. A token selector filters candidate-video features aligned with generated motion, and a bidirectional state-space model efficiently predicts video-moment tuples. Experiments on TVR and ActivityNet-Captions demonstrate that GenSpan improves corpus-level retrieval and moment localization, particularly for complex multi-action queries, while reducing computational cost compared to state-of-the-art multimodal baselines.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 32 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

28 of 32 references.

References · 28

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  3. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  4. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  5. 2022Video Diffusion Modelscited by 2,280
  6. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  7. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  8. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,283
  9. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
  10. 2017Dense-Captioning Events in Videoscited by 789
  11. 2017Localizing Moments in Video with Natural Languagecited by 660
  12. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
16 more
  1. 2020HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-trainingcited by 362
  2. 2024VideoMamba: State Space Model for Efficient Video Understandingcited by 325
  3. 2020TVR: A Large-Scale Dataset for Video-Subtitle Moment Retrievalcited by 215
  4. 2018Localizing Moments in Video with Temporal Languagecited by 83
  5. 2022Temporal Sentence Grounding in Videos: A Survey and Future Directionscited by 37
  6. 2021CONQUER: Contextual Query-aware Ranking for Video Corpus Moment Retrievalcited by 33
  7. 2021A Survey on Temporal Sentence Grounding in Videoscited by 29
  8. 2024SpikeMba: Multi-Modal Spiking Saliency Mamba for Temporal Video Groundingcited by 25
  9. 2022Selective Query-guided Debiasing for Video Corpus Moment Retrievalcited by 18
  10. 2023A Survey on Video Moment Localizationcited by 18
  11. 2025MomentSeeker: A Task-Oriented Benchmark For Long-Video Moment Retrievalcited by 13
  12. 2023What, when, and where? -- Self-Supervised Spatio-Temporal Grounding in Untrimmed Multi-Action Videos from Narrated Instructionscited by 10
  13. 2024Localizing Events in Videos with Multimodal Queriescited by 6
  14. 2024Improving Video Corpus Moment Retrieval with Partial Relevance Enhancementcited by 5
  15. 2024Event-aware Video Corpus Moment Retrievalcited by 4
  16. 2025Boosting Temporal Sentence Grounding via Causal Inferencecited by 3

Built on by

Not cited yet.