LaSER: Internalizing Explicit Reasoning into Latent Space for Dense Retrieval
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
LLMs have fundamentally transformed dense retrieval, upgrading backbones from discriminative encoders to generative architectures. However, a critical disconnect remains: while LLMs possess strong reasoning capabilities, current retrievers predominantly utilize them as static encoders, leaving their potential for complex reasoning unexplored. To address this, existing approaches typically adopt rewrite-then-retrieve pipelines to generate explicit CoT rationales before retrieval. However, this incurs prohibitive latency. In this paper, we propose LaSER, a novel self-distillation framework that internalizes explicit reasoning into the latent space of dense retrievers. Operating on a shared LLM backbone, LaSER introduces a dual-view training mechanism: an Explicit view that explicitly encodes ground-truth reasoning paths, and a Latent view that performs implicit latent thinking. To bridge the gap between these views, we design a multi-grained alignment strategy. Beyond standard output alignment, we introduce a trajectory alignment mechanism that synchronizes the intermediate latent states of the latent path with the semantic progression of the explicit reasoning segments. This allows the retriever to think silently and effectively without autoregressive text generation. Extensive experiments on both in-domain and out-of-domain reasoning-intensive benchmarks demonstrate that LaSER significantly outperforms state-of-the-art baselines. Furthermore, analyses across diverse backbones and model scales validate the robustness of our approach, confirming that our unified learning framework is essential for eliciting effective latent thinking. Our method successfully combines the reasoning depth of explicit CoT pipelines with the inference efficiency of standard dense retrievers.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 43 of its 59 references that are in the map. First posted on arXiv 2 Mar 2026.
Builds on
43 of 59 references.
Closest ancestors · 1
Same direction, newest first
Other references · 42
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,203
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
30 more
- 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 556
- 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 508
- 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 385
- 2023Large Language Models for Information Retrieval: A Surveycited by 331
- 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 320
- 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillationcited by 216
- 2025BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agentcited by 183
- 2024FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation Researchcited by 165
- 2024Jasper and Stella: distillation of SOTA embedding modelscited by 109
- 2025ReasonIR: Training Retrievers for Reasoning Taskscited by 76
- 2025Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoningcited by 72
- 2025DeepAgent: A General Reasoning Agent with Scalable Toolsetscited by 69
- 2024FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructionscited by 67
- 2025A Comprehensive Survey on Knowledge Distillationcited by 49
- 2025ReasonRank: Empowering Passage Ranking with Strong Reasoning Abilitycited by 39
- 2024BIDER: Bridging Knowledge Inconsistency for Efficient Retrieval-Augmented LLMs via Key Supporting Evidencecited by 28
- 2024Understand What LLM Needs: Dual Preference Alignment for Retrieval-Augmented Generationcited by 27
- 2025RaDeR: Reasoning-aware Dense Retrieval Modelscited by 27
- 2024Answer is All You Need: Instruction-following Text Embedding via Answering the Questioncited by 26
- 2024A Survey of Conversational Searchcited by 22
- 2026OmniGAIA: Towards Native Omni-Modal AI Agentscited by 21
- 2025ReasonEmbed: Enhanced Text Embeddings for Reasoning-Intensive Document Retrievalcited by 15
- 2025TongSearch-QR: Reinforced Query Reasoning for Retrievalcited by 11
- 2025ExpandR: Teaching Dense Retrievers Beyond Queries with LLM Guidancecited by 10
- 2025Let LLMs Speak Embedding Languages: Generative Text Embeddings via Iterative Contrastive Refinementcited by 9
- 2025FinSight: Towards Real-World Financial Deep Researchcited by 9
- 2025GRACE: Generative Representation Learning via Contrastive Policy Optimizationcited by 7
- 2025Learning Contextual Retrieval for Robust Conversational Searchcited by 6
- 2025Your Dense Retriever is Secretly an Expeditious Reasonercited by 5
- 2024Dynamic Self-adaptive Multiscale Distillation from Pre-trained Multimodal Large Model for Efficient Cross-modal Representation Learningcited by 2
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026PLUME: Latent Reasoning Based Universal Multimodal Embeddingcited by 10
- 2026LaME: Learning to Think in Latent Space for Multimodal Embedding via Information Bottleneckcited by 5
- 2026Rethinking Reasoning-Intensive Retrieval: Evaluating and Advancing Retrievers in Agentic Search Systemscited by 2
- 2026Xetrieval: Mechanistically Explaining Dense Retrievalcited by 1
- 2026LatentRAG: Latent Reasoning and Retrieval for Efficient Agentic RAGcited by 0
- 2026SHIFT: Self-reconstruction Harnesses Implicit Fine-grained Thinking for Retrievalcited by 0
- 2026Retrieval Grounding Latent Reasoning for Dense Retrievalcited by 0
- 2026VaME: Exploring Variational Latent Reasoning for Multimodal Embeddingscited by 0
- 2026VaME: Exploring Variational Latent Reasoning for Multimodal Embeddings27 Sep 2026
- 2026Retrieval Grounding Latent Reasoning for Dense Retrieval14 Aug 2026
- 2026SHIFT: Self-reconstruction Harnesses Implicit Fine-grained Thinking for Retrieval23 Jul 2026
- 2026LaME: Learning to Think in Latent Space for Multimodal Embedding via Information Bottleneck11 Jun 2026
- 2026Xetrieval: Mechanistically Explaining Dense Retrieval28 May 2026
- 2026LatentRAG: Latent Reasoning and Retrieval for Efficient Agentic RAG7 May 2026
- 2026Rethinking Reasoning-Intensive Retrieval: Evaluating and Advancing Retrievers in Agentic Search Systems5 May 2026
- 2026PLUME: Latent Reasoning Based Universal Multimodal Embedding2 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025KaVa: Latent Reasoning via Compressed KV-Cache Distillation
- 2026Why Struggle with Continuous Latents? Interpretable Discrete Latent Reasoning via Rendered Compression
- 2026Forest Before Trees: Latent Superposition for Efficient Visual Reasoning
- 2026Retrieve, Integrate, and Synthesize: Spatial-Semantic Grounded Latent Visual Reasoning
- 2026Visual Latents Know More Than They Say: Unsilencing Latent Reasoning in MLLMs
- 2026Beyond Dense States: Sparse Transcoders as Causally Testable Operators for LLM Latent Reasoning
- 2026SPOT: Span-level Pause-of-Thought for Efficient and Interpretable Latent Reasoning in Large Language Models
- 2026Render-of-Thought: Rendering Textual Chain-of-Thought as Images for Visual Latent Reasoning