Transforming External Knowledge into Triplets for Enhanced Retrieval in RAG of LLMs
On the map: Retrieval-augmented generation → RAG pipeline design and evaluation
Abstract (arXiv)
Retrieval-Augmented Generation (RAG) mitigates hallucination in large language models (LLMs) by incorporating external knowledge during generation. However, the effectiveness of RAG depends not only on the design of the retriever and the capacity of the underlying model, but also on how retrieved evidence is structured and aligned with the query. Existing RAG approaches typically retrieve and concatenate unstructured text fragments as context, which often introduces redundant or weakly relevant information. This practice leads to excessive context accumulation, reduced semantic alignment, and fragmented reasoning chains, thereby degrading generation quality while increasing token consumption. To address these challenges, we propose Tri-RAG, a structured triplet-based retrieval framework that improves retrieval efficiency through reasoning-aligned context construction. Tri-RAG automatically transforms external knowledge from natural language into standardized structured triplets consisting of Condition, Proof, and Conclusion, explicitly capturing logical relations among knowledge fragments using lightweight prompt-based adaptation with frozen model parameters. Building on this representation, the triplet head Condition is treated as an explicit semantic anchor for retrieval and matching, enabling precise identification of query-relevant knowledge units without directly concatenating lengthy raw texts. As a result, Tri-RAG achieves a favorable balance between retrieval accuracy and context token efficiency. Experimental results across multiple benchmark datasets demonstrate that Tri-RAG significantly improves retrieval quality and reasoning efficiency, while producing more stable generation behavior and more efficient resource utilization in complex reasoning scenarios.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 47 of its 59 references that are in the map. First posted on arXiv 14 Apr 2026.
Builds on
47 of 59 references.
Closest ancestors · 3
Same direction, newest first
- 2024Fine Tuning vs. Retrieval Augmented Generation for Less Popular Knowledge3 Mar
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Survey29 Feb
- 2023Retrieval-Augmented Generation for Large Language Models: A Survey18 Dec
Other references · 44
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,378
32 more
- 2021Improving language models by retrieving from trillions of tokenscited by 1,278
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
- 2021GPT Understands, Toocited by 715
- 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 713
- 2021P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Taskscited by 686
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 653
- 2023Active Retrieval Augmented Generationcited by 506
- 2023Augmented Language Models: a Surveycited by 398
- 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 310
- 2022Autoformalization with Large Language Modelscited by 252
- 2023TheoremQA: A Theorem-driven Question Answering datasetcited by 189
- 2023GraphLLM: Boosting Graph Reasoning Ability of Large Language Modelcited by 105
- 2024Formal Mathematical Reasoning: A New Frontier in AIcited by 80
- 2025Knowledge Graph-Guided Retrieval Augmented Generationcited by 57
- 2024Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologiescited by 44
- 2023Retrieval-augmented Generation to Improve Math Question-Answering: Trade-offs Between Groundedness and Human Preferencecited by 37
- 2024KnowPO: Knowledge-aware Preference Optimization for Controllable Knowledge Selection in Retrieval-Augmented Language Modelscited by 20
- 2026Learning Global Hypothesis Space for Enhancing Synergistic Reasoning Chaincited by 15
- 2026Lightweight LLM Agent Memory with Small Language Modelscited by 12
- 2026Text summarization via global structure awarenesscited by 11
- 2026LLaVA-FA: Learning Fourier Approximation for Compressing Large Multimodal Modelscited by 10
- 2026Language-Guided Token Compression with Reinforcement Learning in Large Vision-Language Modelscited by 9
- 2024SBI-RAG: Enhancing Math Word Problem Solving for Students through Schema-Based Instruction and Retrieval-Augmented Generationcited by 5
- 2025Joint Lossless Compression and Steganography for Medical Images via Large Language Modelscited by 5
- 2026GRASP: Guided Region-Aware Sparse Prompting for Adapting MLLMs to Remote Sensingcited by 5
- 2026Self-Correcting RAG: Enhancing Faithfulness via MMKP Context Selection and NLI-Guided MCTScited by 5
- 2026TDA-RC: Task-Driven Alignment for Knowledge-Based Reasoning Chains in Large Language Modelscited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Beyond Chunks and Graphs: Retrieval-Augmented Generation through Triplet-Driven Thinking
- 2025Know3-RAG: A Knowledge-aware RAG Framework with Adaptive Retrieval, Generation, and Filtering
- 2025RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning
- 2026TaSR-RAG: Taxonomy-guided Structured Reasoning for Retrieval-Augmented Generation
- 2024Multi-Source Knowledge Pruning for Retrieval-Augmented Generation: A Benchmark and Empirical Study
- 2024Astute RAG: Overcoming Imperfect Retrieval Augmentation and Knowledge Conflicts for Large Language Models
- 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generation
- 2025Dynamic and Parametric Retrieval-Augmented Generation