mlsanityData to 7 Oct 2026

RaCoT: Plug-and-Play Contrastive Example Generation Mechanism for Enhanced LLM Reasoning Reliability

arXiv 2510.22710 ↗First posted 26 Oct 2025cs.AIcited by 14

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

also in 1 more
Abstract (arXiv)

Retrieval-Augmented Generation (RAG) faces a core bottleneck with knowledge-sparse and semantically ambiguous long-tail queries, where retrieval noise distorts reasoning and necessitates costly post-processing. To tackle this, we propose RaCoT (Retrieval-aware Contrastive-of-Thought), a novel framework that shifts contrastive thinking to the pre-retrieval stage. By automatically generating a semantically adjacent yet differently answered contrastive question and extracting a Delta-Prompt to capture their key differences, RaCoT guides the model to proactively focus on the ``critical details that determine answer divergence." This approach allows it to suppress semantic interference within a single retrieval pass, overcoming the theoretical bottleneck of single-vector queries that struggle to simultaneously encode signals for what to attend to and what to ignore. On six authoritative benchmarks, including PopQA and TriviaQA-unfiltered, RaCoT outperforms strong baselines like RankRAG and Self-RAG by 0.9-2.4 percentage points. It exhibits superior robustness, with a performance drop of only 8.6% in adversarial tests, far surpassing the over 15% degradation in other methods. Furthermore, its low latency (3.12s) and token overhead (11.54) place it on the accuracy-efficiency Pareto frontier, while ablation studies validate the necessity of each component. Ultimately, RaCoT reframes the RAG paradigm from ``post-hoc context cleaning" to ``a priori shaping of discriminative reasoning", offering an efficient and robust path toward reliable AI systems for real-time, resource-constrained deployments.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 40 of its 62 references that are in the map. First posted on arXiv 26 Oct 2025.

Builds on

40 of 62 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Retrieval-Augmented Generation for Large Language Models: A Survey18 Dec

Other references · 39

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2023GPT-4 Technical Reportcited by 18,132
  5. 2024The Llama 3 Herd of Modelscited by 14,192
  6. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  7. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  8. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  9. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  10. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  11. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  12. 2023A Survey of Large Language Modelscited by 2,537
27 more
  1. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  2. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  3. 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 704
  4. 2023Query Rewriting for Retrieval-Augmented Large Language Modelscited by 211
  5. 2024RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMscited by 200
  6. 2024RQ-RAG: Learning to Refine Queries for Retrieval Augmented Generationcited by 144
  7. 2024A Comprehensive Survey of Retrieval-Augmented Generation (RAG): Evolution, Current Landscape and Future Directionscited by 69
  8. 2024Inference Scaling for Long-Context Retrieval Augmented Generationcited by 65
  9. 2019Long-tail Relation Extraction via Knowledge Graph Embeddings and Graph Convolution Networkscited by 61
  10. 2023PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documentscited by 61
  11. 2025CF-VLM:CounterFactual Vision-Language Fine-tuningcited by 57
  12. 2025GAM-Agent: Game-Theoretic and Uncertainty-Aware Collaboration for Complex Visual Reasoningcited by 56
  13. 2025SWE-Debate: Competitive Multi-Agent Debate for Software Issue Resolutioncited by 52
  14. 2025MAT-Agent: Adaptive Multi-Agent Training Optimizationcited by 34
  15. 2023SAIL: Search-Augmented Instruction Learningcited by 33
  16. 2025DrDiff: Dynamic Routing Diffusion with Hierarchical Attention for Breaking the Efficiency-Quality Trade-offcited by 33
  17. 2025OSC: Cognitive Orchestration through Dynamic Knowledge Alignment in Multi-Agent LLM Collaborationcited by 29
  18. 2024AutoRAG: Automated Framework for optimization of Retrieval Augmented Generation Pipelinecited by 26
  19. 2024RAG-Instruct: Boosting LLMs with Diverse Retrieval-Augmented Instructionscited by 25
  20. 2025AttentionRAG: Attention-Guided Context Pruning in Retrieval-Augmented Generationcited by 19
  21. 2025Failure-Driven Workflow Refinementcited by 19
  22. 2024Contrastive Instruction Tuningcited by 17
  23. 2025Learning Dynamics of VLM Finetuningcited by 17
  24. 2023Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question Answeringcited by 15
  25. 2025QFFT, Question-Free Fine-Tuning for Adaptive Reasoningcited by 15
  26. 2024A Survey of Deep Long-Tail Classification Advancementscited by 11
  27. 2025HiVA: Self-organized Hierarchical Variable Agent via Goal-driven Semantic-Topological Evolutioncited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 10; 2026: 4.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026CRE-T1 Preview Technical Report: Beyond Contrastive Learning for Reasoning-Intensive Retrieval
  2. 2024Eliciting Critical Reasoning in Retrieval-Augmented Language Models via Contrastive Explanations
  3. 2025Self-Routing RAG: Binding Selective Retrieval with Knowledge Verbalization
  4. 2026When to Retrieve During Reasoning: Adaptive Retrieval for Large Reasoning Models
  5. 2025From Sufficiency to Reflection: Reinforcement-Guided Thinking Quality in Retrieval-Augmented Reasoning for LLMs
  6. 2025Better by Comparison: Retrieval-Augmented Contrastive Reasoning for Automatic Prompt Optimization
  7. 2025Retrieval-Augmented Generation: A Comprehensive Survey of Architectures, Enhancements, and Robustness Frontiers
  8. 2026Interpretable Uncertainty for Adaptive Retrieval and Reasoning in Question Answering