ViHERMES: A Graph-Grounded Multihop Question Answering Benchmark and System for Vietnamese Healthcare Regulations
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Question Answering (QA) over regulatory documents is inherently challenging due to the need for multihop reasoning across legally interdependent texts, a requirement that is particularly pronounced in the healthcare domain where regulations are hierarchically structured and frequently revised through amendments and cross-references. Despite recent progress in retrieval-augmented and graph-based QA methods, systematic evaluation in this setting remains limited, especially for low-resource languages such as Vietnamese, due to the lack of benchmark datasets that explicitly support multihop reasoning over healthcare regulations. In this work, we introduce the Vietnamese Healthcare Regulations-Multihop Reasoning Dataset (ViHERMES), a benchmark designed for multihop QA over Vietnamese healthcare regulatory documents. ViHERMES consists of high-quality question-answer pairs that require reasoning across multiple regulations and capture diverse dependency patterns, including amendment tracing, cross-document comparison, and procedural synthesis. To construct the dataset, we propose a controlled multihop QA generation pipeline based on semantic clustering and graph-inspired data mining, followed by large language model-based generation with structured evidence and reasoning annotations. We further present a graph-aware retrieval framework that models formal legal relations at the level of legal units and supports principled context expansion for legally valid and coherent answers. Experimental results demonstrate that ViHERMES provides a challenging benchmark for evaluating multihop regulatory QA systems and that the proposed graph-aware approach consistently outperforms strong retrieval-based baselines. The ViHERMES dataset and system implementation are publicly available at https://github.com/ura-hcmut/ViHERMES.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 14 of its 20 references that are in the map. First posted on arXiv 7 Feb 2026.
Builds on
14 of 20 references.
Closest ancestors · 1
Same direction, newest first
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions20 Dec
Other references · 13
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 519
- 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
- 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 310
- 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 223
- 2025MiniRAG: Towards Extremely Simple Retrieval-Augmented Generationcited by 28
- 2020New Vietnamese Corpus for Machine Reading Comprehension of Health News Articlescited by 23
- 2021A Survey on Legal Question Answering Systemscited by 10
- 2025KoBLEX: Open Legal Question Answering with Multi-hop Reasoningcited by 7
- 2025Using Large Language Models for education managements in Vietnamese with low resourcescited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MKG-Rank: Enhancing Large Language Models with Knowledge Graph for Multilingual Medical Question Answering
- 2026ReGraM: Region-First Knowledge Graph Reasoning for Medical Question Answering
- 2025RAGulating Compliance: A Multi-Agent Knowledge Graph for Regulatory QA
- 2024KorMedMCQA: Multi-Choice Question Answering Benchmark for Korean Healthcare Professional Licensing Examinations
- 2024GRAF: Graph Retrieval Augmented by Facts for Romanian Legal Multi-Choice Question Answering
- 2026VietMed-MCQ: A Consistency-Filtered Data Synthesis Framework for Vietnamese Traditional Medicine Evaluation
- 2025Agentic Medical Knowledge Graphs Enhance Medical Question Answering: Bridging the Gap Between LLMs and Evolving Medical Knowledge
- 2025KG-MuLQA: A Framework for KG-based Multi-Level QA Extraction and Long-Context LLM Evaluation