mlsanityData to 7 Oct 2026

Transforming External Knowledge into Triplets for Enhanced Retrieval in RAG of LLMs

arXiv 2604.12610 ↗First posted 14 Apr 2026cs.CLcited by 3

On the map: Retrieval-augmented generation → RAG pipeline design and evaluation

Abstract (arXiv)

Retrieval-Augmented Generation (RAG) mitigates hallucination in large language models (LLMs) by incorporating external knowledge during generation. However, the effectiveness of RAG depends not only on the design of the retriever and the capacity of the underlying model, but also on how retrieved evidence is structured and aligned with the query. Existing RAG approaches typically retrieve and concatenate unstructured text fragments as context, which often introduces redundant or weakly relevant information. This practice leads to excessive context accumulation, reduced semantic alignment, and fragmented reasoning chains, thereby degrading generation quality while increasing token consumption. To address these challenges, we propose Tri-RAG, a structured triplet-based retrieval framework that improves retrieval efficiency through reasoning-aligned context construction. Tri-RAG automatically transforms external knowledge from natural language into standardized structured triplets consisting of Condition, Proof, and Conclusion, explicitly capturing logical relations among knowledge fragments using lightweight prompt-based adaptation with frozen model parameters. Building on this representation, the triplet head Condition is treated as an explicit semantic anchor for retrieval and matching, enabling precise identification of query-relevant knowledge units without directly concatenating lengthy raw texts. As a result, Tri-RAG achieves a favorable balance between retrieval accuracy and context token efficiency. Experimental results across multiple benchmark datasets demonstrate that Tri-RAG significantly improves retrieval quality and reasoning efficiency, while producing more stable generation behavior and more efficient resource utilization in complex reasoning scenarios.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 47 of its 59 references that are in the map. First posted on arXiv 14 Apr 2026.

Builds on

47 of 59 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Fine Tuning vs. Retrieval Augmented Generation for Less Popular Knowledge3 Mar
  2. 2024Retrieval-Augmented Generation for AI-Generated Content: A Survey29 Feb
  3. 2023Retrieval-Augmented Generation for Large Language Models: A Survey18 Dec

Other references · 44

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  5. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  6. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  7. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  8. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  9. 2017Billion-scale similarity search with GPUscited by 2,477
  10. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  11. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
  12. 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,378
32 more
  1. 2021Improving language models by retrieving from trillions of tokenscited by 1,278
  2. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
  3. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  4. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
  5. 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
  6. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
  7. 2021GPT Understands, Toocited by 715
  8. 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 713
  9. 2021P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Taskscited by 686
  10. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  11. 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 653
  12. 2023Active Retrieval Augmented Generationcited by 506
  13. 2023Augmented Language Models: a Surveycited by 398
  14. 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 310
  15. 2022Autoformalization with Large Language Modelscited by 252
  16. 2023TheoremQA: A Theorem-driven Question Answering datasetcited by 189
  17. 2023GraphLLM: Boosting Graph Reasoning Ability of Large Language Modelcited by 105
  18. 2024Formal Mathematical Reasoning: A New Frontier in AIcited by 80
  19. 2025Knowledge Graph-Guided Retrieval Augmented Generationcited by 57
  20. 2024Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologiescited by 44
  21. 2023Retrieval-augmented Generation to Improve Math Question-Answering: Trade-offs Between Groundedness and Human Preferencecited by 37
  22. 2024KnowPO: Knowledge-aware Preference Optimization for Controllable Knowledge Selection in Retrieval-Augmented Language Modelscited by 20
  23. 2026Learning Global Hypothesis Space for Enhancing Synergistic Reasoning Chaincited by 15
  24. 2026Lightweight LLM Agent Memory with Small Language Modelscited by 12
  25. 2026Text summarization via global structure awarenesscited by 11
  26. 2026LLaVA-FA: Learning Fourier Approximation for Compressing Large Multimodal Modelscited by 10
  27. 2026Language-Guided Token Compression with Reinforcement Learning in Large Vision-Language Modelscited by 9
  28. 2024SBI-RAG: Enhancing Math Word Problem Solving for Students through Schema-Based Instruction and Retrieval-Augmented Generationcited by 5
  29. 2025Joint Lossless Compression and Steganography for Medical Images via Large Language Modelscited by 5
  30. 2026GRASP: Guided Region-Aware Sparse Prompting for Adapting MLLMs to Remote Sensingcited by 5
  31. 2026Self-Correcting RAG: Enhancing Faithfulness via MMKP Context Selection and NLI-Guided MCTScited by 5
  32. 2026TDA-RC: Task-Driven Alignment for Knowledge-Based Reasoning Chains in Large Language Modelscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Beyond Chunks and Graphs: Retrieval-Augmented Generation through Triplet-Driven Thinking
  2. 2025Know3-RAG: A Knowledge-aware RAG Framework with Adaptive Retrieval, Generation, and Filtering
  3. 2025RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning
  4. 2026TaSR-RAG: Taxonomy-guided Structured Reasoning for Retrieval-Augmented Generation
  5. 2024Multi-Source Knowledge Pruning for Retrieval-Augmented Generation: A Benchmark and Empirical Study
  6. 2024Astute RAG: Overcoming Imperfect Retrieval Augmentation and Knowledge Conflicts for Large Language Models
  7. 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generation
  8. 2025Dynamic and Parametric Retrieval-Augmented Generation