CoVR-R:Reason-Aware Composed Video Retrieval
Not on the map. Why?
Abstract (arXiv)
Composed Video Retrieval (CoVR) aims to find a target video given a reference video and a textual modification. Prior work assumes the modification text fully specifies the visual changes, overlooking after-effects and implicit consequences (e.g., motion, state transitions, viewpoint or duration cues) that emerge from the edit. We argue that successful CoVR requires reasoning about these after-effects. We introduce a reasoning-first, zero-shot approach that leverages large multimodal models to (i) infer causal and temporal consequences implied by the edit, and (ii) align the resulting reasoned queries to candidate videos without task-specific finetuning. To evaluate reasoning in CoVR, we also propose CoVR-Reason, a benchmark that pairs each (reference, edit, target) triplet with structured internal reasoning traces and challenging distractors that require predicting after-effects rather than keyword matching. Experiments show that our zero-shot method outperforms strong retrieval baselines on recall at K and particularly excels on implicit-effect subsets. Our automatic and human analysis confirm higher step consistency and effect factuality in our retrieved results. Our findings show that incorporating reasoning into general-purpose multimodal models enables effective CoVR by explicitly accounting for causal and temporal after-effects. This reduces dependence on task-specific supervision, improves generalization to challenging implicit-effect cases, and enhances interpretability of retrieval outcomes. These results point toward a scalable and principled framework for explainable video search. The model, code, and benchmark are available at https://github.com/mbzuai-oryx/CoVR-R.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 31 of its 37 references that are in the map. First posted on arXiv 20 Mar 2026.
Builds on
31 of 37 references.
References · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2025Qwen3 Technical Reportcited by 8,195
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2017The "something something" video database for learning and evaluating visual common sensecited by 1,092
- 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 596
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 364
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 296
- 2021Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Modelscited by 244
- 2018Composing Text and Image for Image Retrieval - An Empirical Odysseycited by 234
- 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 203
19 more
- 2022Fine-tuned CLIP Models are Efficient Video Learnerscited by 178
- 2023Zero-Shot Composed Image Retrieval with Textual Inversioncited by 171
- 2023Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrievalcited by 155
- 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMscited by 145
- 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoningcited by 134
- 2021TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignmentcited by 102
- 2023CompoDiff: Versatile Composed Image Retrieval With Latent Diffusioncited by 84
- 2025Skywork R1V: Pioneering Multimodal Reasoning with Chain-of-Thoughtcited by 69
- 2023CoVR-2: Automatic Data Construction for Composed Video Retrievalcited by 52
- 2019Fashion IQ: A New Dataset Towards Retrieving Images by Natural Language Feedbackcited by 42
- 2024Reason-before-Retrieve: One-Stage Reflective Chain-of-Thoughts for Training-Free Zero-Shot Composed Image Retrievalcited by 31
- 2024Composed Video Retrieval via Enriched Context and Discriminative Embeddingscited by 26
- 2025A Comprehensive Survey on Composed Image Retrievalcited by 17
- 2025DATE: Dynamic Absolute Time Enhancement for Long Video Understandingcited by 9
- 2025QuickVideo: Real-Time Long Video Understanding with System Algorithm Co-Designcited by 7
- 2025Multimodal Reasoning Agent for Zero-Shot Composed Image Retrievalcited by 7
- 2025Beyond Simple Edits: Composed Video Retrieval with Dense Modificationscited by 6
- 2025MLLM-Guided VLM Fine-Tuning with Joint Inference for Zero-Shot Composed Image Retrievalcited by 5
- 2025How Good are Foundation Models in Step-by-Step Embodied Reasoning?cited by 1
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026EgoAdapt: A Multi-Scene Egocentric Adaptation Method for CVPR 2026 HD-EPIC VQA Challengecited by 5
- 2026TempRet: Temporal Enhancement and Two-Stage Reranking for CVPR 2026 EPIC-KITCHENS-100 Multi-Instance Retrieval Challengecited by 4
- 2026R^3: Composed Video Retrieval via Reasoning-Guided Recalling and Re-rankingcited by 4
- 2026Reason, Retrieve, Re-rank: A Zero-Shot Reasoning-Aware Framework for Composed Video Retrievalcited by 1
- 2026Dual-Route Top-K Retrieval with 1v1 VLM Reranking for the CoVR-Rcited by 1
- 2026Training-Free Composed Video Retrieval via Visual Representation-Guided Video-LLM Reasoningcited by 1
- 2026Reason-Then-Retrieve for CoVR-R with Structured Edit Prompts and Dense-Sparse Fusioncited by 1
- 2026Beyond Similarity: Foundation Models as an Efficient Backbone for Training-Free Composed Video Retrievalcited by 0
- 2026Beyond Similarity: Foundation Models as an Efficient Backbone for Training-Free Composed Video Retrieval9 Sep 2026
- 2026Reason-Then-Retrieve for CoVR-R with Structured Edit Prompts and Dense-Sparse Fusion1 Jun 2026
- 2026Training-Free Composed Video Retrieval via Visual Representation-Guided Video-LLM Reasoning1 Jun 2026
- 2026R^3: Composed Video Retrieval via Reasoning-Guided Recalling and Re-ranking31 May 2026
- 2026Dual-Route Top-K Retrieval with 1v1 VLM Reranking for the CoVR-R31 May 2026
- 2026Reason, Retrieve, Re-rank: A Zero-Shot Reasoning-Aware Framework for Composed Video Retrieval30 May 2026
- 2026EgoAdapt: A Multi-Scene Egocentric Adaptation Method for CVPR 2026 HD-EPIC VQA Challenge23 May 2026
- 2026TempRet: Temporal Enhancement and Two-Stage Reranking for CVPR 2026 EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge23 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026PREGEN: Uncovering Latent Thoughts in Composed Video Retrieval
- 2026X-Aligner: Composed Visual Retrieval without the Bells and Whistles
- 2025Reasoning Text-to-Video Retrieval via Digital Twin Video Representations and Large Language Models
- 2026VideoSearch-R1: Iterative Video Retrieval and Reasoning via Soft Query Refinement
- 2025LoVR: A Benchmark for Long Video Retrieval in Multimodal Contexts
- 2026QSVideo: Query-Conditioned Semantic Temporal Retrieval for Video Understanding
- 2026TF-PRVR: Training-Free Partially Relevant Video Retrieval
- 2026A Very Big Video Reasoning Suite