Derivation Prompting: A Logic-Based Method for Improving Retrieval-Augmented Generation
On the map: Retrieval-augmented generation → RAG robustness and adaptive retrieval
Abstract (arXiv)
The application of Large Language Models to Question Answering has shown great promise, but important challenges such as hallucinations and erroneous reasoning arise when using these models, particularly in knowledge-intensive, domain-specific tasks. To address these issues, we introduce Derivation Prompting, a novel prompting technique for the generation step of the Retrieval-Augmented Generation framework. Inspired by logic derivations, this method involves deriving conclusions from initial hypotheses through the systematic application of predefined rules. It constructs a derivation tree that is interpretable and adds control over the generation process. We applied this method in a specific case study, significantly reducing unacceptable answers compared to traditional RAG and long-context window methods.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RAG robustness and adaptive retrieval, one of 15 directions in Retrieval-augmented generation. Builds on 15 of its 17 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
15 of 17 references.
References · 15
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
- 2019Passage Re-ranking with BERTcited by 645
- 2022Towards Reasoning in Large Language Models: A Surveycited by 596
- 2023Prometheus: Inducing Fine-grained Evaluation Capability in Language Modelscited by 575
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023IAG: Induction-Augmented Generation Framework for Answering Reasoning Questions
- 2025Retrieval Augmented Question Answering: When Should LLMs Admit Ignorance?
- 2026Interpretable Uncertainty for Adaptive Retrieval and Reasoning in Question Answering
- 2026Prompt-Based Abstention Fails Under Misleading Context: A Controlled Study of Small Frozen RAG Models
- 2023Modeling Uncertainty and Using Post-fusion as Fallback Improves Retrieval Augmented Generation with LLMs
- 2025LAG: Logic-Augmented Generation from a Cartesian Perspective
- 2024Awakening Augmented Generation: Learning to Awaken Internal Knowledge of Large Language Models for Question Answering
- 2025Emulating Retrieval Augmented Generation via Prompt Engineering for Enhanced Long Context Comprehension in LLMs