CRE-T1 Preview Technical Report: Beyond Contrastive Learning for Reasoning-Intensive Retrieval
Not on the map. Why?
Abstract (arXiv)
The central challenge of reasoning-intensive retrieval lies in identifying implicitreasoning relationships between queries and documents, rather than superficial se-mantic or lexical similarity. The contrastive learning paradigm is fundamentallya static representation consolidation technique: during training, it encodes hier-archical relevance concepts into fixed geometric structures in the vector space,and at inference time it cannot dynamically adjust relevance judgments accord-ing to the specific reasoning demands of each query. Consequently, performancedegrades noticeably when vocabulary mismatch exists between queries and doc-uments or when implicit reasoning is required to establish relevance. This pa-per proposes Thought 1 (T1), a generative retrieval model that shifts relevancemodeling from static alignment to dynamic reasoning. On the query side, T1 dy-namically generates intermediate reasoning trajectories for each query to bridgeimplicit reasoning relationships and uses <embtoken> as a semantic aggregationpoint for the reasoning output. On the document side, it employs an instruction+ text + <embtoken> encoding format to support high-throughput indexing. Tointernalize dynamic reasoning capabilities into vector representations, we adopt athree-stage training curriculum and introduce GRPO in the third stage, enablingthe model to learn optimal derivation strategies for different queries through trial-and-error reinforcement learning. On the BRIGHT benchmark, T1-4B exhibitsstrong performance under the original query setting, outperforming larger modelstrained with contrastive learning overall, and achieving performance comparableto multi-stage retrieval pipelines. The results demonstrate that replacing static rep-resentation alignment with dynamic reasoning generation can effectively improvereasoning-intensive retrieval performance.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 21 references that are in the map. First posted on arXiv 18 Mar 2026.
Builds on
18 of 21 references.
References · 18
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2025Qwen3 Technical Reportcited by 8,820
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
- 2022MTEB: Massive Text Embedding Benchmarkcited by 640
- 2024BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrievalcited by 158
- 2025ReasonIR: Training Retrievers for Reasoning Taskscited by 77
- 2025Rank1: Test-Time Compute for Reranking in Information Retrievalcited by 70
- 2025DeepRetrieval: Hacking Real Search Engines and Retrievers with Large Language Models via Reinforcement Learningcited by 66
- 2025ReasonRank: Empowering Passage Ranking with Strong Reasoning Abilitycited by 42
- 2025Rank-K: Test-Time Reasoning for Listwise Rerankingcited by 29
6 more
- 2025RaDeR: Reasoning-aware Dense Retrieval Modelscited by 27
- 2025ReasonEmbed: Enhanced Text Embeddings for Reasoning-Intensive Document Retrievalcited by 16
- 2025TongSearch-QR: Reinforced Query Reasoning for Retrievalcited by 11
- 2025Refine Thought: A Test-Time Inference Method for Embedding Model Reasoningcited by 2
- 2025Reinforced Information Retrievalcited by 1
- 2026Time-Scaling Is What Agents Need Nowcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025RaCoT: Plug-and-Play Contrastive Example Generation Mechanism for Enhanced LLM Reasoning Reliability
- 2024Eliciting Critical Reasoning in Retrieval-Augmented Language Models via Contrastive Explanations
- 2025Toward Structured Knowledge Reasoning: Contrastive Retrieval-Augmented Generation on Experience
- 2026Multi-Step Semantic Reasoning in Generative Retrieval
- 2026When to Retrieve During Reasoning: Adaptive Retrieval for Large Reasoning Models
- 2025Retrieval-in-the-Chain: Bootstrapping Large Language Models for Generative Retrieval
- 2026A Survey of Reasoning-Intensive Retrieval: Progress and Challenges
- 2025Retro*: Optimizing LLMs for Reasoning-Intensive Document Retrieval