mlsanityData to 7 Oct 2026

RAG-Match: Retrieval-Augmented Knowledge Injection and Hierarchical Reasoning for Calibrated Semantic Relevance

arXiv 2605.25486 ↗First posted 25 May 2026cs.IRcited by 0

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

also in 1 more
Abstract (arXiv)

Semantic relevance judgment for search is particularly challenging in knowledge-intensive scenarios, where accurate ranking requires not only semantic matching but also background grounding, multi-step reasoning, and well-calibrated decision boundaries. Existing relevance models mainly rely on direct label supervision or shallow semantic similarity, which limits their ability to handle implicit intent, factual equivalence, and fine-grained relevance distinctions. To address this issue, we propose textscRAG-Match, a three-stage framework that integrates knowledge-augmented pretraining, hierarchical reasoning alignment, and preference-based decision calibration for relevance modeling. The key idea is to first strengthen query-centered semantic grounding, then align the model with structured relevance reasoning, and finally correct decision-level inconsistencies in difficult boundary cases. Experimental results on a real-world search relevance benchmark show that textscRAG-Match consistently outperforms strong LLM-based baselines across multiple ranking metrics, demonstrating the effectiveness of combining knowledge injection, reasoning supervision, and preference optimization for fine-grained relevance judgment.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 38 references that are in the map. First posted on arXiv 25 May 2026.

Builds on

32 of 38 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025TaoSR1: The Thinking Model for E-commerce Relevance Search17 Aug
  2. 2023Retrieval-Augmented Generation for Large Language Models: A Survey18 Dec

Other references · 30

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  6. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  7. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  8. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  9. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  10. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  11. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  12. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
18 more
  1. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
  2. 2023Large Language Models are not Fair Evaluatorscited by 1,050
  3. 2019Passage Re-ranking with BERTcited by 629
  4. 2023Large Language Models for Information Retrieval: A Surveycited by 331
  5. 2023Faithful Chain-of-Thought Reasoningcited by 285
  6. 2015Stacked Attention Networks for Image Question Answeringcited by 273
  7. 2023Fine-Tuning LLaMA for Multi-Stage Text Retrievalcited by 271
  8. 2017A Deep Relevance Matching Model for Ad-hoc Retrievalcited by 126
  9. 2013A Theoretical Analysis of NDCG Type Ranking Measurescited by 119
  10. 2019Deeper Text Understanding for IR with Contextual Neural Language Modelingcited by 111
  11. 2022Task-aware Retrieval with Instructionscited by 107
  12. 2023Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question Answeringcited by 97
  13. 2016A Thorough Examination of the CNN/Daily Mail Reading Comprehension Taskcited by 71
  14. 2022InPars: Data Augmentation for Information Retrieval using Large Language Modelscited by 60
  15. 2025SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyondcited by 47
  16. 2025Optimizing Generative Ranking Relevance via Reinforcement Learning in Xiaohongshu Searchcited by 11
  17. 2025LREF: A Novel LLM-based Relevance Framework for E-commercecited by 7
  18. 2025ADORE: Autonomous Domain-Oriented Relevance Engine for E-commercecited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025R3A: Reinforced Reasoning for Relevance Assessment for RAG in User-Generated Content Platforms
  2. 2026GuidedRAG: Semantic Steering of Retrieval-Augmented Generation
  3. 2026DF-RAG: Query-Aware Diversity for Retrieval-Augmented Generation
  4. 2025RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning
  5. 2025Know3-RAG: A Knowledge-aware RAG Framework with Adaptive Retrieval, Generation, and Filtering
  6. 2025ClueAnchor: Clue-Anchored Knowledge Reasoning Exploration and Optimization for Retrieval-Augmented Generation
  7. 2024JudgeRank: Leveraging Large Language Models for Reasoning-Intensive Reranking
  8. 2025Self-Routing RAG: Binding Selective Retrieval with Knowledge Verbalization