mlsanityData to 7 Oct 2026

LaSER: Internalizing Explicit Reasoning into Latent Space for Dense Retrieval

arXiv 2603.01425 ↗First posted 2 Mar 2026cs.CL cs.IRcited by 8

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

LLMs have fundamentally transformed dense retrieval, upgrading backbones from discriminative encoders to generative architectures. However, a critical disconnect remains: while LLMs possess strong reasoning capabilities, current retrievers predominantly utilize them as static encoders, leaving their potential for complex reasoning unexplored. To address this, existing approaches typically adopt rewrite-then-retrieve pipelines to generate explicit CoT rationales before retrieval. However, this incurs prohibitive latency. In this paper, we propose LaSER, a novel self-distillation framework that internalizes explicit reasoning into the latent space of dense retrievers. Operating on a shared LLM backbone, LaSER introduces a dual-view training mechanism: an Explicit view that explicitly encodes ground-truth reasoning paths, and a Latent view that performs implicit latent thinking. To bridge the gap between these views, we design a multi-grained alignment strategy. Beyond standard output alignment, we introduce a trajectory alignment mechanism that synchronizes the intermediate latent states of the latent path with the semantic progression of the explicit reasoning segments. This allows the retriever to think silently and effectively without autoregressive text generation. Extensive experiments on both in-domain and out-of-domain reasoning-intensive benchmarks demonstrate that LaSER significantly outperforms state-of-the-art baselines. Furthermore, analyses across diverse backbones and model scales validate the robustness of our approach, confirming that our unified learning framework is essential for eliciting effective latent thinking. Our method successfully combines the reasoning depth of explicit CoT pipelines with the inference efficiency of standard dense retrievers.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 43 of its 59 references that are in the map. First posted on arXiv 2 Mar 2026.

Builds on

43 of 59 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Think Then Embed: Generative Context Improves Multimodal Embedding6 Oct

Other references · 42

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  5. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  6. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  7. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
  8. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
  9. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,203
  10. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  11. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
  12. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
30 more
  1. 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 556
  2. 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 508
  3. 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 385
  4. 2023Large Language Models for Information Retrieval: A Surveycited by 331
  5. 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 320
  6. 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillationcited by 216
  7. 2025BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agentcited by 183
  8. 2024FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation Researchcited by 165
  9. 2024Jasper and Stella: distillation of SOTA embedding modelscited by 109
  10. 2025ReasonIR: Training Retrievers for Reasoning Taskscited by 76
  11. 2025Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoningcited by 72
  12. 2025DeepAgent: A General Reasoning Agent with Scalable Toolsetscited by 69
  13. 2024FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructionscited by 67
  14. 2025A Comprehensive Survey on Knowledge Distillationcited by 49
  15. 2025ReasonRank: Empowering Passage Ranking with Strong Reasoning Abilitycited by 39
  16. 2024BIDER: Bridging Knowledge Inconsistency for Efficient Retrieval-Augmented LLMs via Key Supporting Evidencecited by 28
  17. 2024Understand What LLM Needs: Dual Preference Alignment for Retrieval-Augmented Generationcited by 27
  18. 2025RaDeR: Reasoning-aware Dense Retrieval Modelscited by 27
  19. 2024Answer is All You Need: Instruction-following Text Embedding via Answering the Questioncited by 26
  20. 2024A Survey of Conversational Searchcited by 22
  21. 2026OmniGAIA: Towards Native Omni-Modal AI Agentscited by 21
  22. 2025ReasonEmbed: Enhanced Text Embeddings for Reasoning-Intensive Document Retrievalcited by 15
  23. 2025TongSearch-QR: Reinforced Query Reasoning for Retrievalcited by 11
  24. 2025ExpandR: Teaching Dense Retrievers Beyond Queries with LLM Guidancecited by 10
  25. 2025Let LLMs Speak Embedding Languages: Generative Text Embeddings via Iterative Contrastive Refinementcited by 9
  26. 2025FinSight: Towards Real-World Financial Deep Researchcited by 9
  27. 2025GRACE: Generative Representation Learning via Contrastive Policy Optimizationcited by 7
  28. 2025Learning Contextual Retrieval for Robust Conversational Searchcited by 6
  29. 2025Your Dense Retriever is Secretly an Expeditious Reasonercited by 5
  30. 2024Dynamic Self-adaptive Multiscale Distillation from Pre-trained Multimodal Large Model for Efficient Cross-modal Representation Learningcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025KaVa: Latent Reasoning via Compressed KV-Cache Distillation
  2. 2026Why Struggle with Continuous Latents? Interpretable Discrete Latent Reasoning via Rendered Compression
  3. 2026Forest Before Trees: Latent Superposition for Efficient Visual Reasoning
  4. 2026Retrieve, Integrate, and Synthesize: Spatial-Semantic Grounded Latent Visual Reasoning
  5. 2026Visual Latents Know More Than They Say: Unsilencing Latent Reasoning in MLLMs
  6. 2026Beyond Dense States: Sparse Transcoders as Causally Testable Operators for LLM Latent Reasoning
  7. 2026SPOT: Span-level Pause-of-Thought for Efficient and Interpretable Latent Reasoning in Large Language Models
  8. 2026Render-of-Thought: Rendering Textual Chain-of-Thought as Images for Visual Latent Reasoning