Reason to Contrast: A Cascaded Multimodal Retrieval Framework
Not on the map. Why?
Abstract (arXiv)
Traditional multimodal retrieval systems rely primarily on bi-encoder architectures, where performance is closely tied to embedding dimensionality. Recent work, Think-Then-Embed (TTE), shows that incorporating multimodal reasoning to elicit additional informative tokens before embedding can further improve retrieval. In this paper, we extend this paradigm with TTE-v2, a hybrid multimodal retrieval framework that introduces reasoning-driven performance scaling based on additional input token budget rather than model or embedding size. Our approach augments the initial multimodal retrieval with additional reasoning steps for reranking, enabling more expressive query-candidate interactions at test time. The reranking stage further provides fine-grained supervision for hard negative mining and false negative filtering, creating a feedback loop that effectively strengthens the upstream retriever. This cascaded design delivers substantial test-time improvements based on intermediate reasoning token scaling. Experiments on the MMEB-V2 benchmark demonstrate that TTE-v2-7B achieves a new state-of-the-art accuracy of 75.7%, and that TTE-v2-2B matches or surpasses leading 7B models trained with significantly larger external data. Our results highlight the promise of token-wise scaling as an alternative scaling paradigm for multimodal retrieval.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Dec 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Unlocking Multimodal Document Intelligence: From Current Triumphs to Future Frontiers of Visual Document Retrievalcited by 8
- 2026Beyond Chain-of-Thought: Rewrite as a Universal Interface for Generative Multimodal Embeddingscited by 5
- 2026MOON3.0: Reasoning-aware Multimodal Representation Learning for E-commerce Product Understandingcited by 4
- 2026Douyin Multimodal Embedding Model Technical Reportcited by 2
- 2026MoEMB: Scaling Universal Multimodal Embeddings with Efficient Mixture-of-Experts Modelscited by 0
- 2026Is Reasoning Always Useful? Rethinking Reasoning Utility in Universal Multimodal Embeddingscited by 0
- 2026MetaEncoder: Exploring the Limit of Bi-Encoders for Multimodal System One Decision Making with Natural Language Interfacecited by 0
- 2026MetaEncoder: Exploring the Limit of Bi-Encoders for Multimodal System One Decision Making with Natural Language Interface8 Oct 2026
- 2026MoEMB: Scaling Universal Multimodal Embeddings with Efficient Mixture-of-Experts Models8 Sep 2026
- 2026Is Reasoning Always Useful? Rethinking Reasoning Utility in Universal Multimodal Embeddings26 Aug 2026
- 2026Douyin Multimodal Embedding Model Technical Report3 Aug 2026
- 2026Beyond Chain-of-Thought: Rewrite as a Universal Interface for Generative Multimodal Embeddings24 Apr 2026
- 2026MOON3.0: Reasoning-aware Multimodal Representation Learning for E-commerce Product Understanding1 Apr 2026
- 2026Unlocking Multimodal Document Intelligence: From Current Triumphs to Future Frontiers of Visual Document Retrieval23 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026MARVEL: Multimodal Adaptive Reasoning-intensiVe Expand-rerank and retrievaL
- 2025Reasoning Guided Embeddings: Leveraging MLLM Reasoning for Improved Multimodal Retrieval
- 2025MetaEmbed: Scaling Multimodal Retrieval at Test-Time with Flexible Late Interaction
- 2026Reason What Matters: Retrieval-Grounded Reasoning for Universal Multimodal Embeddings
- 2026Learning from Failures: Retrieval-Centric CoT via Hard Negatives for Unified Multimodal Retrieval
- 2026Reasoning-Augmented Representations for Multimodal Retrieval
- 2026Think When Needed: Adaptive Reasoning-Driven Multimodal Embeddings with a Dual-LoRA Architecture
- 2026UMER: Unifying Embedding and Ranking via Pair-Aware Discriminative Reasoning for Universal Multimodal Retrieval