mlsanityData to 14 Oct 2026

XHotpotQA: A Benchmark for Cross-Lingual Knowledge Composition in Multi-Hop Question Answering

arXiv 2608.27481 ↗First posted 23 Aug 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Knowledge-intensive multi-hop question answering requires systems to select evidence and compose dependent facts, yet multilingual benchmarks usually translate an entire example into one language. This hides failures at language boundaries inside the reasoning chain. We introduce XHotpotQA, a controlled benchmark for cross-lingual knowledge composition over mixed-language evidence. Each instance is modeled as an evidence-dependency graph whose question, bridge evidence, answer-bearing evidence, and distractors have explicit language assignments. The audited resource contains 15,661 training and 7,405 validation instances, with sentence-level support supervision and supplied distractors. In validation, 99.81% of items cross the question-to-gold-evidence language interface and 95.60% use gold paragraphs in different languages. Across three reader artifacts, full question-evidence mismatch is associated with 10.25 to 15.79 lower Unicode-aware answer F1 than partial alignment, and different-script evidence with deficits of 11.98 to 23.70 points; the corresponding adapted-selector contrasts are 1.71 and 1.78 points. Under this supplied-candidate design, the evaluated readers therefore show substantially larger condition-associated deficits than the selector. XHotpotQA provides role-aware diagnostics, modular evaluation, and an audited test bed for knowledge-based systems that must integrate evidence across languages.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 47 references that are in the map. First posted on arXiv 23 Aug 2026.

Builds on

24 of 47 references.

References · 24

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  4. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  5. 2018Datasheets for Datasetscited by 1,386
  6. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
  7. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
  8. 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 916
  9. 2019On the Cross-lingual Transferability of Monolingual Representationscited by 578
  10. 2019MLQA: Evaluating Cross-lingual Extractive Question Answeringcited by 340
  11. 2020MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answeringcited by 153
  12. 2024Aya 23: Open Weight Releases to Further Multilingual Progresscited by 123
12 more
  1. 2020XOR QA: Cross-lingual Open-Retrieval Question Answeringcited by 121
  2. 2022Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answeringcited by 72
  3. 2022Multi-hop Question Answeringcited by 64
  4. 2024Generate-then-Ground in Retrieval-Augmented Generation for Multi-hop Question Answeringcited by 51
  5. 2019Multi-hop Question Answering via Reasoning Chainscited by 42
  6. 2024EfficientRAG: Efficient Retriever for Multi-Hop Question Answeringcited by 24
  7. 2019Multi-step Entity-centric Information Retrieval for Multi-Hop Question Answeringcited by 20
  8. 2025XRAG: Cross-lingual Retrieval-Augmented Generationcited by 9
  9. 2026DaPT: A Dual-Path Framework for Multilingual Multi-hop Question Answeringcited by 3
  10. 2025Bactrainus: Optimizing Large Language Models for Multi-hop Complex Question Answering Taskscited by 1
  11. 2026Do Language Models Reason Across Languages?cited by 1
  12. 2026Quantifying the Impact of Translation Errors on Multilingual LLM Evaluationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024MINTQA: A Multi-Hop Question Answering Benchmark for Evaluating LLMs on New and Tail Knowledge
  2. 2026Better Decomposition, Free Aggregation: A Synthesizer-Folding Framework for Multilingual Multi-Hop Question Answering
  3. 2025KG-o1: Enhancing Multi-hop Question Answering in Large Language Models via Knowledge Graph Integration
  4. 2026BRIDGE: Benchmark for multi-hop Reasoning In long multimodal Documents with Grounded Evidence
  5. 2024Retrieval-enhanced Knowledge Editing in Language Models for Multi-Hop Question Answering
  6. 2026CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps
  7. 2025StepChain GraphRAG: Reasoning Over Knowledge Graphs for Multi-Hop Question Answering
  8. 2024MLaKE: Multilingual Knowledge Editing Benchmark for Large Language Models