mlsanityData to 14 Oct 2026

Is Reasoning Always Useful? Rethinking Reasoning Utility in Universal Multimodal Embeddings

arXiv 2609.29560 ↗First posted 26 Aug 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Reasoning-enhanced universal multimodal embeddings (UME) improve heterogeneous retrieval, but plausible rationales do not necessarily produce discriminative rankings. We study this gap by comparing the discriminative (DISC) and reasoning-driven generative (GEN) branches of UME-R1, a state-of-the-art reasoning UME method. We decompose reasoning utility into positive-target gain, hard-negative gain, and their margin difference. Positive similarity increases for 56.6%, but 15.7% are false-helpful cases where reasoning moves hard negatives closer even more. Local-neighborhood and token-attribution diagnostics suggest why: reasoning often de-condenses retrieved neighborhoods, but utility requires separator-aligned movement, while influential CoT tokens frequently encode evidence shared by positives and hard negatives. Motivated by these diagnostics, we propose SURE (Score-structure Utility Router for Embeddings), which improves UME-R1-7B by 1.5 points and yields consistent gains on two additional embedding models on MMEB-V2, without retraining, label-based policy selection, or extra VLM forward passes.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 36 references that are in the map. First posted on arXiv 26 Aug 2026.

Builds on

18 of 36 references.

References · 18

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  5. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  6. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
  7. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
  8. 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 230
  9. 2025VLM2Vec-V2: Advancing Multimodal Embedding for Videos, Images, and Visual Documentscited by 116
  10. 2025UniME-V2: MLLM-as-a-Judge for Universal Multimodal Embedding Learningcited by 42
  11. 2025Think Then Embed: Generative Context Improves Multimodal Embeddingcited by 41
  12. 2025UME-R1: Exploring Reasoning-Driven Generative Multimodal Embeddingscited by 38
6 more
  1. 2026Embed-RL: Reinforcement Learning for Reasoning-Driven Multimodal Embeddingscited by 24
  2. 2025Retrv-R1: A Reasoning-Driven MLLM Framework for Universal and Efficient Multimodal Retrievalcited by 12
  3. 2026PLUME: Latent Reasoning Based Universal Multimodal Embeddingcited by 11
  4. 2025Reason to Contrast: A Cascaded Multimodal Retrieval Frameworkcited by 7
  5. 2026TRACE: Task-Adaptive Reasoning and Representation Learning for Universal Multimodal Retrievalcited by 7
  6. 2026MMEmb-R1: Reasoning-Enhanced Multimodal Embedding with Pair-Aware Selection and Adaptive Controlcited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Reasoning Guided Embeddings: Leveraging MLLM Reasoning for Improved Multimodal Retrieval
  2. 2026Reason What Matters: Retrieval-Grounded Reasoning for Universal Multimodal Embeddings
  3. 2026LaME: Learning to Think in Latent Space for Multimodal Embedding via Information Bottleneck
  4. 2026Think When Needed: Adaptive Reasoning-Driven Multimodal Embeddings with a Dual-LoRA Architecture
  5. 2026UMER: Unifying Embedding and Ranking via Pair-Aware Discriminative Reasoning for Universal Multimodal Retrieval
  6. 2026TTE-Flash: Accelerating Reasoning-based Multimodal Representations via Think-Then-Embed Tokens
  7. 2026Reasoning-Augmented Representations for Multimodal Retrieval
  8. 2026Learning from Failures: Retrieval-Centric CoT via Hard Negatives for Unified Multimodal Retrieval