RAG-Match: Retrieval-Augmented Knowledge Injection and Hierarchical Reasoning for Calibrated Semantic Relevance
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
also in 1 more
Abstract (arXiv)
Semantic relevance judgment for search is particularly challenging in knowledge-intensive scenarios, where accurate ranking requires not only semantic matching but also background grounding, multi-step reasoning, and well-calibrated decision boundaries. Existing relevance models mainly rely on direct label supervision or shallow semantic similarity, which limits their ability to handle implicit intent, factual equivalence, and fine-grained relevance distinctions. To address this issue, we propose textscRAG-Match, a three-stage framework that integrates knowledge-augmented pretraining, hierarchical reasoning alignment, and preference-based decision calibration for relevance modeling. The key idea is to first strengthen query-centered semantic grounding, then align the model with structured relevance reasoning, and finally correct decision-level inconsistencies in difficult boundary cases. Experimental results on a real-world search relevance benchmark show that textscRAG-Match consistently outperforms strong LLM-based baselines across multiple ranking metrics, demonstrating the effectiveness of combining knowledge injection, reasoning supervision, and preference optimization for fine-grained relevance judgment.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 38 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
32 of 38 references.
Closest ancestors · 2
Same direction, newest first
- 2025TaoSR1: The Thinking Model for E-commerce Relevance Search17 Aug
- 2023Retrieval-Augmented Generation for Large Language Models: A Survey18 Dec
Other references · 30
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
18 more
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
- 2023Large Language Models are not Fair Evaluatorscited by 1,050
- 2019Passage Re-ranking with BERTcited by 629
- 2023Large Language Models for Information Retrieval: A Surveycited by 331
- 2023Faithful Chain-of-Thought Reasoningcited by 285
- 2015Stacked Attention Networks for Image Question Answeringcited by 273
- 2023Fine-Tuning LLaMA for Multi-Stage Text Retrievalcited by 271
- 2017A Deep Relevance Matching Model for Ad-hoc Retrievalcited by 126
- 2013A Theoretical Analysis of NDCG Type Ranking Measurescited by 119
- 2019Deeper Text Understanding for IR with Contextual Neural Language Modelingcited by 111
- 2022Task-aware Retrieval with Instructionscited by 107
- 2023Knowledge-Driven CoT: Exploring Faithful Reasoning in LLMs for Knowledge-intensive Question Answeringcited by 97
- 2016A Thorough Examination of the CNN/Daily Mail Reading Comprehension Taskcited by 71
- 2022InPars: Data Augmentation for Information Retrieval using Large Language Modelscited by 60
- 2025SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyondcited by 47
- 2025Optimizing Generative Ranking Relevance via Reinforcement Learning in Xiaohongshu Searchcited by 11
- 2025LREF: A Novel LLM-based Relevance Framework for E-commercecited by 7
- 2025ADORE: Autonomous Domain-Oriented Relevance Engine for E-commercecited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025R3A: Reinforced Reasoning for Relevance Assessment for RAG in User-Generated Content Platforms
- 2026GuidedRAG: Semantic Steering of Retrieval-Augmented Generation
- 2026DF-RAG: Query-Aware Diversity for Retrieval-Augmented Generation
- 2025RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning
- 2025Know3-RAG: A Knowledge-aware RAG Framework with Adaptive Retrieval, Generation, and Filtering
- 2025ClueAnchor: Clue-Anchored Knowledge Reasoning Exploration and Optimization for Retrieval-Augmented Generation
- 2024JudgeRank: Leveraging Large Language Models for Reasoning-Intensive Reranking
- 2025Self-Routing RAG: Binding Selective Retrieval with Knowledge Verbalization