mlsanityData to 7 Oct 2026

CoVR-R:Reason-Aware Composed Video Retrieval

arXiv 2603.20190 ↗First posted 20 Mar 2026cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Composed Video Retrieval (CoVR) aims to find a target video given a reference video and a textual modification. Prior work assumes the modification text fully specifies the visual changes, overlooking after-effects and implicit consequences (e.g., motion, state transitions, viewpoint or duration cues) that emerge from the edit. We argue that successful CoVR requires reasoning about these after-effects. We introduce a reasoning-first, zero-shot approach that leverages large multimodal models to (i) infer causal and temporal consequences implied by the edit, and (ii) align the resulting reasoned queries to candidate videos without task-specific finetuning. To evaluate reasoning in CoVR, we also propose CoVR-Reason, a benchmark that pairs each (reference, edit, target) triplet with structured internal reasoning traces and challenging distractors that require predicting after-effects rather than keyword matching. Experiments show that our zero-shot method outperforms strong retrieval baselines on recall at K and particularly excels on implicit-effect subsets. Our automatic and human analysis confirm higher step consistency and effect factuality in our retrieved results. Our findings show that incorporating reasoning into general-purpose multimodal models enables effective CoVR by explicitly accounting for causal and temporal after-effects. This reduces dependence on task-specific supervision, improves generalization to challenging implicit-effect cases, and enhances interpretability of retrieval outcomes. These results point toward a scalable and principled framework for explainable video search. The model, code, and benchmark are available at https://github.com/mbzuai-oryx/CoVR-R.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 31 of its 37 references that are in the map. First posted on arXiv 20 Mar 2026.

Builds on

31 of 37 references.

References · 31

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  4. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  5. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  6. 2017The "something something" video database for learning and evaluating visual common sensecited by 1,092
  7. 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 596
  8. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 364
  9. 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 296
  10. 2021Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Modelscited by 244
  11. 2018Composing Text and Image for Image Retrieval - An Empirical Odysseycited by 234
  12. 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 203
19 more
  1. 2022Fine-tuned CLIP Models are Efficient Video Learnerscited by 178
  2. 2023Zero-Shot Composed Image Retrieval with Textual Inversioncited by 171
  3. 2023Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrievalcited by 155
  4. 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMscited by 145
  5. 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoningcited by 134
  6. 2021TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignmentcited by 102
  7. 2023CompoDiff: Versatile Composed Image Retrieval With Latent Diffusioncited by 84
  8. 2025Skywork R1V: Pioneering Multimodal Reasoning with Chain-of-Thoughtcited by 69
  9. 2023CoVR-2: Automatic Data Construction for Composed Video Retrievalcited by 52
  10. 2019Fashion IQ: A New Dataset Towards Retrieving Images by Natural Language Feedbackcited by 42
  11. 2024Reason-before-Retrieve: One-Stage Reflective Chain-of-Thoughts for Training-Free Zero-Shot Composed Image Retrievalcited by 31
  12. 2024Composed Video Retrieval via Enriched Context and Discriminative Embeddingscited by 26
  13. 2025A Comprehensive Survey on Composed Image Retrievalcited by 17
  14. 2025DATE: Dynamic Absolute Time Enhancement for Long Video Understandingcited by 9
  15. 2025QuickVideo: Real-Time Long Video Understanding with System Algorithm Co-Designcited by 7
  16. 2025Multimodal Reasoning Agent for Zero-Shot Composed Image Retrievalcited by 7
  17. 2025Beyond Simple Edits: Composed Video Retrieval with Dense Modificationscited by 6
  18. 2025MLLM-Guided VLM Fine-Tuning with Joint Inference for Zero-Shot Composed Image Retrievalcited by 5
  19. 2025How Good are Foundation Models in Step-by-Step Embodied Reasoning?cited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026PREGEN: Uncovering Latent Thoughts in Composed Video Retrieval
  2. 2026X-Aligner: Composed Visual Retrieval without the Bells and Whistles
  3. 2025Reasoning Text-to-Video Retrieval via Digital Twin Video Representations and Large Language Models
  4. 2026VideoSearch-R1: Iterative Video Retrieval and Reasoning via Soft Query Refinement
  5. 2025LoVR: A Benchmark for Long Video Retrieval in Multimodal Contexts
  6. 2026QSVideo: Query-Conditioned Semantic Temporal Retrieval for Video Understanding
  7. 2026TF-PRVR: Training-Free Partially Relevant Video Retrieval
  8. 2026A Very Big Video Reasoning Suite