Enhanced Partially Relevant Video Retrieval through Inter- and Intra-Sample Analysis with Coherence Prediction
Not on the map. Why?
Abstract (arXiv)
Partially Relevant Video Retrieval (PRVR) aims to retrieve the target video that is partially relevant to the text query. The primary challenge in PRVR arises from the semantic asymmetry between textual and visual modalities, as videos often contain substantial content irrelevant to the query. Existing methods coarsely align paired videos and text queries to construct the semantic space, neglecting the critical cross-modal dual nature inherent in this task: inter-sample correlation and intra-sample redundancy. To this end, we propose a novel PRVR framework to systematically exploit these two characteristics. Our framework consists of three core modules. First, the Inter Correlation Enhancement (ICE) module captures inter-sample correlation by identifying semantically similar yet unpaired text queries and video moments, combining them to form pseudo-positive pairs for more robust semantic space construction. Second, the Intra Redundancy Mining (IRM) module mitigates intra-sample redundancy by mining redundant moment features and distinguishing them from query-relevant moments, encouraging the model to learn more discriminative representations. Finally, to reinforce these modules, we introduce the Temporal Coherence Prediction (TCP) module, enhancing discrimination of fine-grained moment-level semantics by training the model to predict the original temporal order of randomly shuffled video sequences. Extensive experiments demonstrate the superiority of our method, achieving state-of-the-art results.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 40 of its 69 references that are in the map. First posted on arXiv 28 Apr 2025.
Builds on
40 of 69 references.
References · 40
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2017Dense-Captioning Events in Videoscited by 793
- 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 657
28 more
- 2017TALL: Temporal Activity Localization via Language Querycited by 584
- 2019VATEX: A Large-Scale, High-Quality Multilingual Dataset for Video-and-Language Researchcited by 414
- 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 317
- 2019Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Languagecited by 285
- 2020Span-based Localizing Network for Natural Language Video Localizationcited by 235
- 2020TVR: A Large-Scale Dataset for Video-Subtitle Moment Retrievalcited by 215
- 2023Unmasked Teacher: Towards Training-Efficient Video Foundation Modelscited by 199
- 2023UniVTG: Towards Unified Video-Language Temporal Groundingcited by 190
- 2020Local-Global Video-Text Interactions for Temporal Groundingcited by 188
- 2020Fine-grained Video-Text Retrieval with Hierarchical Graph Reasoningcited by 180
- 2023Query-Dependent Video Representation for Moment Retrieval and Highlight Detectioncited by 166
- 2019Semantic Conditioned Dynamic Modulation for Temporal Sentence Grounding in Videoscited by 135
- 2021Negative Sample Matters: A Renaissance of Metric Learning for Temporal Groundingcited by 90
- 2022Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?cited by 90
- 2018Dual Encoding for Zero-Example Video Retrievalcited by 85
- 2021Kaleido-BERT: Vision-Language Pre-training on Fashion Domaincited by 67
- 2021Video Corpus Moment Retrieval with Contrastive Learningcited by 60
- 2021On Pursuit of Designing Multi-modal Transformer for Video Groundingcited by 54
- 2018Iterative Reorganization with Weak Spatial Constraints: Solving Arbitrary Jigsaw Puzzles for Unsupervised Representation Learningcited by 51
- 2022Reading-strategy Inspired Visual Representation Learning for Text-to-Video Retrievalcited by 34
- 2021CONQUER: Contextual Query-aware Ranking for Video Corpus Moment Retrievalcited by 33
- 2021Embracing Uncertainty: Decoupling and De-bias for Robust Temporal Groundingcited by 29
- 2020A Hierarchical Multi-Modal Encoder for Moment Localization in Video Corpuscited by 26
- 2023GMMFormer: Gaussian-Mixture-Model Based Transformer for Efficient Partially Relevant Video Retrievalcited by 20
- 2021Multi-Modal Interaction Graph Convolutional Network for Temporal Language Localization in Videoscited by 16
- 2023Background-aware Moment Detection for Video Moment Retrievalcited by 13
- 2025Prototypes are Balanced Units for Efficient and Effective Partially Relevant Video Retrievalcited by 8
- 2022PRVR: Partially Relevant Video Retrievalcited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.