Logic-Oriented Retriever Enhancement via Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) struggle in knowledge-intensive tasks, as retrievers often overfit to surface similarity and fail on queries involving complex logical relations. The capacity for logical analysis is inherent in model representations but remains underutilized in standard training. LORE (Logic ORiented Retriever Enhancement) introduces fine-grained contrastive learning to activate this latent capacity, guiding embeddings toward evidence aligned with logical structure rather than shallow similarity. LORE requires no external upervision, resources, or pre-retrieval analysis, remains index-compatible, and consistently improves retrieval utility and downstream generation while maintaining efficiency. The datasets and code are publicly available at https://github.com/mazehart/Lore-RAG.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 17 references that are in the map. First posted on arXiv 1 Feb 2026.
Builds on
15 of 17 references.
References · 15
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 519
- 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 339
- 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 329
3 more
- 2024Similarity is Not All You Need: Endowing Retrieval Augmented Generation with Multi Layered Thoughtscited by 16
- 2024Beyond Benchmarks: Evaluating Embedding Model Similarity for Retrieval Augmented Generation Systemscited by 12
- 2024Mindful-RAG: A Study of Points of Failure in Retrieval Augmented Generationcited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026CRE-T1 Preview Technical Report: Beyond Contrastive Learning for Reasoning-Intensive Retrieval
- 2023DQ-LoRe: Dual Queries with Low Rank Approximation Re-ranking for In-Context Learning
- 2025Large Reasoning Embedding Models: Towards Next-Generation Dense Retrieval Paradigm
- 2024From Artificial Needles to Real Haystacks: Improving Retrieval Capabilities in LLMs by Finetuning on Synthetic Data
- 2024Eliciting Critical Reasoning in Retrieval-Augmented Language Models via Contrastive Explanations
- 2025A Comparative Study of Specialized LLMs as Dense Retrievers
- 2025Toward Structured Knowledge Reasoning: Contrastive Retrieval-Augmented Generation on Experience
- 2026Are LLM-Based Retrievers Worth Their Cost? An Empirical Study of Efficiency, Robustness, and Reasoning Overhead