When Names Cross Scripts: A Source-Grounded Benchmark for Historical Entity Reconciliation in the Mongol World
Not on the map. Why?
Abstract (arXiv)
Historical people may appear under different languages, scripts, and transcription traditions, while distinct individuals may share highly similar or even identical names. This makes historical identity reconciliation more than a problem of string matching or transliteration. We introduce MHER, a provenance-controlled benchmark for pairwise reconciliation of person-name attestations from the Mongol world. MHER contains a balanced 396-pair Name-only core over 84 primary historical persons and a stricter 160-pair Source-grounded subset constructed from mention-by-source evidence, with entity-disjoint development and test splits. Across five generative systems, correctly Source-grounded evidence improves paired TEST accuracy by 12.96 to 94.44 percentage points relative to Name-only input. On five identical-surface different-person cases, all models fail under names alone (0/25 model-item decisions), whereas Source-grounded evidence yields 24/25 correct resolutions, with the remaining output an abstention. Context-only ablations show that historical descriptions often carry substantial identity information, while explicitly signaled misgrounding controls produce substantially lower performance. We also find that names are not uniformly beneficial: for Qwen3-8B, restoring surface forms converts ten otherwise correct Context-only distinctions into false identity merges. These results show that historical entity reconciliation depends not only on surface correspondence, but on whether identity judgments respond appropriately to provenance-controlled historical evidence. MHER therefore provides a controlled framework for studying evidence use, abstention, and failure modes in historical NLP.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 26 references that are in the map. First posted on arXiv 24 Aug 2026.
Builds on
15 of 26 references.
References · 15
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 876
- 2018Annotation Artifacts in Natural Language Inference Datacited by 671
- 2023Enabling Large Language Models to Generate Text with Citationscited by 595
- 2024Know Your Limits: A Survey of Abstention in Large Language Modelscited by 121
- 2023ExpertQA: Expert-Curated Questions and Attributed Answerscited by 97
- 2020Entity Linking in 100 Languagescited by 52
- 2021Multilingual Autoregressive Entity Linkingcited by 50
- 2021Named Entity Recognition and Classification on Historical Documents: A Surveycited by 47
- 2021MOLEMAN: Mention-Only Linking of Entities with a Mention Annotation Networkcited by 10
- 2023Learn to Not Link: Exploring NIL Prediction in Entity Linkingcited by 7
- 2024ParaNames 1.0: Creating an Entity Name Corpus for 400+ Languages using Wikidatacited by 5
3 more
- 2026Scripts Through Time: A Survey of the Evolving Role of Transliteration in NLPcited by 4
- 2018Bootstrapping Transliteration with Constrained Discovery for Low-Resource Languagescited by 3
- 2026It's All About the Confidence: An Unsupervised Approach for Multilingual Historical Entity Linking using Large Language Modelscited by 1
Built on by
Not cited yet.