Training-Free Composed Video Retrieval via Visual Representation-Guided Video-LLM Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Recent advances in large vision-language models have expanded video retrieval from simple text-based search to more flexible scenarios, where users may specify the desired result through both visual examples and textual instructions. In the CVPR 2026 Reason-Aware Composed Video Retrieval Challenge, the system is required to retrieve a target video according to a reference video and a modification instruction. To address this task, we develop Visual Representation-Guided Video-LLM Reasoning for Training-Free Composed Video Retrieval. Our framework first uses frozen DINOv3 models to obtain a compact set of visually relevant candidates, and then applies large vision-language models to evaluate whether each candidate satisfies the modification instruction. A final reasoning-based refinement is further performed on the top candidates to improve the first-ranked prediction. Without training, our system achieves 48.78 Recall@1 and 51.48 Recall@5 on the test set. Future work may further improve retrieval accuracy through stronger video-LLMs and detailed integration between visual representations and language reasoning.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 30 of its 33 references that are in the map. First posted on arXiv 1 Jun 2026.
Builds on
30 of 33 references.
References · 30
- 2023GPT-4 Technical Reportcited by 18,132
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2017The Kinetics Human Action Video Datasetcited by 1,894
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
18 more
- 2017The "something something" video database for learning and evaluating visual common sensecited by 1,092
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
- 2023VideoMAE V2: Scaling Video Masked Autoencoders with Dual Maskingcited by 516
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
- 2023Siamese Masked Autoencoderscited by 75
- 2019ViSiL: Fine-grained Spatio-Temporal Video Similarity Learningcited by 41
- 2018Adaptive Temporal Encoding Network for Video Instance-level Human Parsingcited by 36
- 2024VideoMAC: Video Masked Autoencoders Meet ConvNetscited by 20
- 2025When the Future Becomes the Past: Taming Temporal Correspondence for Self-supervised Video Representation Learningcited by 14
- 2023Self-Supervised Video Similarity Learningcited by 12
- 2024Not All Pairs are Equal: Hierarchical Learning for Average-Precision-Oriented Video Retrievalcited by 9
- 2026CoVR-R:Reason-Aware Composed Video Retrievalcited by 8
- 2025Exploring Structural Degradation in Dense Representations for Self-supervised Learningcited by 4
- 2025Bootstrapping Physics-Grounded Video Generation through VLM-Guided Iterative Self-Refinementcited by 3
- 2026From Static to Dynamic: Exploring Self-supervised Image-to-Video Representation Transfer Learningcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2023Long Video Understanding with Learnable Retrieval in Video-Language Models
- 2026Reason, Retrieve, Re-rank: A Zero-Shot Reasoning-Aware Framework for Composed Video Retrieval
- 2025Reasoning Text-to-Video Retrieval via Digital Twin Video Representations and Large Language Models
- 2026R^3: Composed Video Retrieval via Reasoning-Guided Recalling and Re-ranking
- 2025Vgent: Graph-based Retrieval-Reasoning-Augmented Generation For Long Video Understanding
- 2026QSVideo: Query-Conditioned Semantic Temporal Retrieval for Video Understanding
- 2025Enhancing Subsequent Video Retrieval via Vision-Language Models (VLMs)
- 2025E-VRAG: Enhancing Long Video Understanding with Resource-Efficient Retrieval Augmented Generation