Reasoning Quality Matters: Combating Reasoning Collapse in LLM-based Embedding Learning
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Large Language Models (LLMs) have recently shown strong potential for producing context-rich text embeddings for retrieval. Most existing methods either treat embedding learning as passive feature extraction or exploit LLM reasoning through instruction following for better embedding optimization. However, specialization toward embedding objectives can suppress useful reasoning generation or produce retrieval-irrelevant text. We refer to these two forms of degradation as reasoning collapse. To address this issue, we propose CoFree (Collapse-Free Reasoning Embedding), a two-stage framework that progressively integrates LLM reasoning into query and document embedding optimization while preserving reasoning quality. At the first stage, CoFree applies reference-guided supervised fine-tuning to restore the reasoning ability and retain representational strength of the foundation embedding model. At the second stage, we introduce dual rewards, an embedding-oriented reward and a reasoning-oriented reward, to guarantee fine-grained reasoning of the relevance toward the embedding goal in reinforcement learning. This endpoint-coupled optimization transforms embedding learning from static alignment into a high-quality reasoning-guided search process for retrieval. Extensive experiments demonstrate the effectiveness of CoFree, with CoFree-4B achieving an average absolute improvement of 2.8 nDCG@10 points over Qwen3-Embedding-4B across 22 datasets from MTEB and BRIGHT. Online experiments in a real-world retrieval system further show consistent gains. Code, RTED, and model checkpoints will be made publicly available.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 30 of its 63 references that are in the map. First posted on arXiv 17 Sep 2026.
Builds on
30 of 63 references.
Closest ancestors · 1
Same direction, newest first
Other references · 29
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2025Qwen3 Technical Reportcited by 8,820
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2023Qwen Technical Reportcited by 3,344
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
17 more
- 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 723
- 2024Phi-4 Technical Reportcited by 711
- 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 654
- 2019Neural Text Generation with Unlikelihood Trainingcited by 503
- 2024NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Modelscited by 472
- 2024LLM2Vec: Large Language Models Are Secretly Powerful Text Encoderscited by 404
- 2024mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrievalcited by 236
- 2024BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrievalcited by 158
- 2024jina-embeddings-v3: Multilingual Embeddings With Task LoRAcited by 141
- 2025EmbeddingGemma: Powerful and Lightweight Text Representationscited by 139
- 2024Jasper and Stella: distillation of SOTA embedding modelscited by 112
- 2023Llama2Vec: Unsupervised Adaptation of Large Language Models for Dense Retrievalcited by 78
- 2025Think Then Embed: Generative Context Improves Multimodal Embeddingcited by 41
- 2025UME-R1: Exploring Reasoning-Driven Generative Multimodal Embeddingscited by 38
- 2021Contrastive Attraction and Contrastive Repulsion for Representation Learningcited by 13
- 2023Language Models are Universal Embedderscited by 11
- 2025F2LLM Technical Report: Matching SOTA Embedding Performance with 6 Million Open-Source Datacited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Exploring Reasoning-Infused Text Embedding with Large Language Models for Zero-Shot Dense Retrieval
- 2025LLM-guided Hierarchical Search for End-to-end Reasoning Intensive Retrieval
- 2024RAR-b: Reasoning as Retrieval Benchmark
- 2025Soft Reasoning: Navigating Solution Spaces in Large Language Models through Controlled Embedding Exploration
- 2025Reasoning Guided Embeddings: Leveraging MLLM Reasoning for Improved Multimodal Retrieval
- 2026Reason What Matters: Retrieval-Grounded Reasoning for Universal Multimodal Embeddings
- 2025Large Reasoning Embedding Models: Towards Next-Generation Dense Retrieval Paradigm
- 2026Think When Needed: Adaptive Reasoning-Driven Multimodal Embeddings with a Dual-LoRA Architecture