mlsanityData to 7 Oct 2026

Conformal Path Reasoning: Trustworthy Knowledge Graph Question Answering via Path-Level Calibration

arXiv 2605.08077 ↗First posted 8 May 2026cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Knowledge Graph Question Answering (KGQA) offers grounded, interpretable reasoning, but existing methods often fail to provide reliable coverage guarantees over retrieved answers. While Conformal Prediction (CP) offers a principled framework for producing prediction sets with statistical guarantees, prior conformal KGQA methods suffer from two critical pitfalls: violated coverage guarantees due to invalid calibration, and weak score discriminability that yields excessively large prediction sets. We propose Conformal Path Reasoning (CPR), a novel trustworthy KGQA framework built on two key innovations. First, query-level conformal calibration over path-level scores preserves exchangeability to ensure valid coverage guarantees. Second, we introduce the Residual Conformal Value Network (RCVNet), a lightweight module trained via PUCT-guided exploration to learn discriminative path-level nonconformity scores. Extensive experiments show that CPR significantly improves the Empirical Coverage Rate by 45% while reducing prediction set size by 52% on average over conformal baselines across benchmark datasets, highlighting its effectiveness for reliable conformal reasoning over knowledge graphs.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 38 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

28 of 38 references.

References · 28

  1. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  2. 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
  3. 2016Distribution-Free Predictive Inference For Regressioncited by 657
  4. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  5. 2018The Web as a Knowledge-base for Answering Complex Questionscited by 409
  6. 2022Conformal prediction beyond exchangeabilitycited by 348
  7. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
  8. 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 265
  9. 2023A Survey of Confidence Estimation and Calibration in Large Language Modelscited by 253
  10. 2023Conformal Language Modelingcited by 163
  11. 2021Monte Carlo Tree Search: A Review of Recent Modifications and Applicationscited by 158
  12. 2020Beta Embeddings for Multi-Hop Logical Reasoning in Knowledge Graphscited by 128
16 more
  1. 2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodalcited by 106
  2. 2021Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signalscited by 100
  3. 2023Uncertainty Quantification over Graph with Conformalized Graph Neural Networkscited by 79
  4. 2024API Is Enough: Conformal Prediction for Large Language Models Without Logit-Accesscited by 68
  5. 2021Complex Knowledge Base Question Answering: A Surveycited by 52
  6. 2018An Interpretable Reasoning Network for Multi-Relation Question Answeringcited by 47
  7. 2024Paths-over-Graph: Knowledge Graph Empowered Large Language Model Reasoningcited by 44
  8. 2022Conformal Prediction with Temporal Quantile Adjustmentscited by 25
  9. 2023TRAQ: Trustworthy Retrieval Augmented Question Answering via Conformal Predictioncited by 23
  10. 2023Transductive conformal inference with adaptive scorescited by 21
  11. 2025DeepSieve: Information Sieving via LLM-as-a-Knowledge-Routercited by 13
  12. 2025Certainty in Uncertainty: Reasoning over Uncertain Knowledge Graphs with Statistical Guaranteescited by 9
  13. 2024Conformalized Answer Set Prediction for Knowledge Graph Embeddingcited by 5
  14. 2024Towards Trustworthy Knowledge Graph Reasoning: An Uncertainty Aware Perspectivecited by 5
  15. 2025Node-as-Agent: Graph Agentic Networkcited by 2
  16. 2025A Systematic Review of Conformal Inference Procedures for Treatment Effect Estimation: Methods and Challengescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.