RaCoT: Plug-and-Play Contrastive Example Generation Mechanism for Enhanced LLM Reasoning Reliability
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
also in 1 more
Abstract (arXiv)
Retrieval-Augmented Generation (RAG) faces a core bottleneck with knowledge-sparse and semantically ambiguous long-tail queries, where retrieval noise distorts reasoning and necessitates costly post-processing. To tackle this, we propose RaCoT (Retrieval-aware Contrastive-of-Thought), a novel framework that shifts contrastive thinking to the pre-retrieval stage. By automatically generating a semantically adjacent yet differently answered contrastive question and extracting a Delta-Prompt to capture their key differences, RaCoT guides the model to proactively focus on the ``critical details that determine answer divergence." This approach allows it to suppress semantic interference within a single retrieval pass, overcoming the theoretical bottleneck of single-vector queries that struggle to simultaneously encode signals for what to attend to and what to ignore. On six authoritative benchmarks, including PopQA and TriviaQA-unfiltered, RaCoT outperforms strong baselines like RankRAG and Self-RAG by 0.9-2.4 percentage points. It exhibits superior robustness, with a performance drop of only 8.6% in adversarial tests, far surpassing the over 15% degradation in other methods. Furthermore, its low latency (3.12s) and token overhead (11.54) place it on the accuracy-efficiency Pareto frontier, while ablation studies validate the necessity of each component. Ultimately, RaCoT reframes the RAG paradigm from ``post-hoc context cleaning" to ``a priori shaping of discriminative reasoning", offering an efficient and robust path toward reliable AI systems for real-time, resource-constrained deployments.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 40 of its 62 references that are in the map. First posted on arXiv 26 Oct 2025.
Builds on
40 of 62 references.
Closest ancestors · 1
Same direction, newest first
Other references · 39
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2023A Survey of Large Language Modelscited by 2,537
27 more
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
- 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 704
- 2023Query Rewriting for Retrieval-Augmented Large Language Modelscited by 211
- 2024RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMscited by 200
- 2024RQ-RAG: Learning to Refine Queries for Retrieval Augmented Generationcited by 144
- 2024A Comprehensive Survey of Retrieval-Augmented Generation (RAG): Evolution, Current Landscape and Future Directionscited by 69
- 2024Inference Scaling for Long-Context Retrieval Augmented Generationcited by 65
- 2019Long-tail Relation Extraction via Knowledge Graph Embeddings and Graph Convolution Networkscited by 61
- 2023PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documentscited by 61
- 2025CF-VLM:CounterFactual Vision-Language Fine-tuningcited by 57
- 2025GAM-Agent: Game-Theoretic and Uncertainty-Aware Collaboration for Complex Visual Reasoningcited by 56
- 2025SWE-Debate: Competitive Multi-Agent Debate for Software Issue Resolutioncited by 52
- 2025MAT-Agent: Adaptive Multi-Agent Training Optimizationcited by 34
- 2023SAIL: Search-Augmented Instruction Learningcited by 33
- 2025DrDiff: Dynamic Routing Diffusion with Hierarchical Attention for Breaking the Efficiency-Quality Trade-offcited by 33
- 2025OSC: Cognitive Orchestration through Dynamic Knowledge Alignment in Multi-Agent LLM Collaborationcited by 29
- 2024AutoRAG: Automated Framework for optimization of Retrieval Augmented Generation Pipelinecited by 26
- 2024RAG-Instruct: Boosting LLMs with Diverse Retrieval-Augmented Instructionscited by 25
- 2025AttentionRAG: Attention-Guided Context Pruning in Retrieval-Augmented Generationcited by 19
- 2025Failure-Driven Workflow Refinementcited by 19
- 2024Contrastive Instruction Tuningcited by 17
- 2025Learning Dynamics of VLM Finetuningcited by 17
- 2023Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question Answeringcited by 15
- 2025QFFT, Question-Free Fine-Tuning for Adaptive Reasoningcited by 15
- 2024A Survey of Deep Long-Tail Classification Advancementscited by 11
- 2025HiVA: Self-organized Hierarchical Variable Agent via Goal-driven Semantic-Topological Evolutioncited by 3
Built on by
Citing papers per year: 2025: 10; 2026: 4.
14 papers.
Sort:
By area:
- 2025LLM-CAS: Dynamic Neuron Perturbation for Real-Time Hallucination Correctioncited by 15
- 2025FlashVLM: Text-Guided Visual Token Selection for Large Multimodal Modelscited by 11
- 2026Group Editing: Edit Multiple Images in One Gocited by 11
- 2025STORM: Search-Guided Generative World Models for Robotic Manipulationcited by 7
- 2026Is Agentic RAG worth it? An experimental comparison of RAG approachescited by 5
- 2025CoAgent: Collaborative Planning and Consistency Agent for Coherent Video Generationcited by 4
- 2025MoE-DiffuSeq: Enhancing Long-Document Diffusion Models with Sparse Attention and Mixture of Expertscited by 1
- 2026InstanceAnimator: Multi-Instance Sketch Video Colorizationcited by 1
- 2025Causal Invariance and Counterfactual Learning Driven Cooperative Game for Multi-Label Classificationcited by 0
- 2025SirenPose: Dynamic Scene Reconstruction via Geometric Supervisioncited by 0
- 2025A Three-Level Alignment Framework for Large-Scale 3D Retrieval and Controlled 4D Generationcited by 0
- 2025Towards Efficient Post-Training via Fourier-Driven Adapter Architecturescited by 0
- 2026InstanceAnimator: Multi-Instance Sketch Video Colorization26 Mar 2026
- 2026Group Editing: Edit Multiple Images in One Go24 Mar 2026
- 2026DNF: Dual-Layer Nested Fingerprinting for Large Language Model Intellectual Property Protection13 Jan 2026
- 2026Is Agentic RAG worth it? An experimental comparison of RAG approaches12 Jan 2026
- 2025Self-Rewarded Multimodal Coherent Reasoning Across Diverse Visual Domains27 Dec 2025
- 2025CoAgent: Collaborative Planning and Consistency Agent for Coherent Video Generation27 Dec 2025
- 2025Towards Efficient Post-Training via Fourier-Driven Adapter Architectures26 Dec 2025
- 2025A Three-Level Alignment Framework for Large-Scale 3D Retrieval and Controlled 4D Generation25 Dec 2025
- 2025MoE-DiffuSeq: Enhancing Long-Document Diffusion Models with Sparse Attention and Mixture of Experts23 Dec 2025
- 2025FlashVLM: Text-Guided Visual Token Selection for Large Multimodal Models23 Dec 2025
- 2025SirenPose: Dynamic Scene Reconstruction via Geometric Supervision23 Dec 2025
- 2025LLM-CAS: Dynamic Neuron Perturbation for Real-Time Hallucination Correction21 Dec 2025
- 2025LLM-CAS: Dynamic Neuron Perturbation for Real-Time Hallucination Correctioncited by 15
- 2026Group Editing: Edit Multiple Images in One Gocited by 11
- 2025CoAgent: Collaborative Planning and Consistency Agent for Coherent Video Generationcited by 4
- 2025Causal Invariance and Counterfactual Learning Driven Cooperative Game for Multi-Label Classificationcited by 0
- 2025SirenPose: Dynamic Scene Reconstruction via Geometric Supervisioncited by 0
- 2025A Three-Level Alignment Framework for Large-Scale 3D Retrieval and Controlled 4D Generationcited by 0
- 2025Towards Efficient Post-Training via Fourier-Driven Adapter Architecturescited by 0
- 2026Group Editing: Edit Multiple Images in One Go24 Mar 2026
- 2025CoAgent: Collaborative Planning and Consistency Agent for Coherent Video Generation27 Dec 2025
- 2025Towards Efficient Post-Training via Fourier-Driven Adapter Architectures26 Dec 2025
- 2025A Three-Level Alignment Framework for Large-Scale 3D Retrieval and Controlled 4D Generation25 Dec 2025
- 2025SirenPose: Dynamic Scene Reconstruction via Geometric Supervision23 Dec 2025
- 2025LLM-CAS: Dynamic Neuron Perturbation for Real-Time Hallucination Correction21 Dec 2025
- 2025Causal Invariance and Counterfactual Learning Driven Cooperative Game for Multi-Label Classification30 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026CRE-T1 Preview Technical Report: Beyond Contrastive Learning for Reasoning-Intensive Retrieval
- 2024Eliciting Critical Reasoning in Retrieval-Augmented Language Models via Contrastive Explanations
- 2025Self-Routing RAG: Binding Selective Retrieval with Knowledge Verbalization
- 2026When to Retrieve During Reasoning: Adaptive Retrieval for Large Reasoning Models
- 2025From Sufficiency to Reflection: Reinforcement-Guided Thinking Quality in Retrieval-Augmented Reasoning for LLMs
- 2025Better by Comparison: Retrieval-Augmented Contrastive Reasoning for Automatic Prompt Optimization
- 2025Retrieval-Augmented Generation: A Comprehensive Survey of Architectures, Enhancements, and Robustness Frontiers
- 2026Interpretable Uncertainty for Adaptive Retrieval and Reasoning in Question Answering