Bridging the Language Gap: Knowledge Injected Multilingual Question Answering
Not on the map. Why?
Abstract (arXiv)
Question Answering (QA) is the task of automatically answering questions posed by humans in natural languages. There are different settings to answer a question, such as abstractive, extractive, boolean, and multiple-choice QA. As a popular topic in natural language processing tasks, extractive question answering task (extractive QA) has gained extensive attention in the past few years. With the continuous evolvement of the world, generalized cross-lingual transfer (G-XLT), where question and answer context are in different languages, poses some unique challenges over cross-lingual transfer (XLT), where question and answer context are in the same language. With the boost of corresponding development of related benchmarks, many works have been done to improve the performance of various language QA tasks. However, only a few works are dedicated to the G-XLT task. In this work, we propose a generalized cross-lingual transfer framework to enhance the model's ability to understand different languages. Specifically, we first assemble triples from different languages to form multilingual knowledge. Since the lack of knowledge between different languages greatly limits models' reasoning ability, we further design a knowledge injection strategy via leveraging link prediction techniques to enrich the model storage of multilingual knowledge. In this way, we can profoundly exploit rich semantic knowledge. Experiment results on real-world datasets MLQA demonstrate that the proposed method can improve the performance by a large margin, outperforming the baseline method by 13.18%/12.00% F1/EM on average.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 22 of its 35 references that are in the map. First posted on arXiv 6 Apr 2023.
Builds on
22 of 35 references.
References · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
- 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,492
- 2019Cross-lingual Language Model Pretrainingcited by 1,090
- 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 528
- 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
- 2019MLQA: Evaluating Cross-lingual Extractive Question Answeringcited by 340
10 more
- 2019KG-BERT: BERT for Knowledge Graph Completioncited by 324
- 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 319
- 2019Knowledge Enhanced Contextual Word Representationscited by 296
- 2020ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-trainingcited by 222
- 2019Dice Loss for Data-imbalanced NLP Taskscited by 182
- 2019SenseBERT: Driving Some Sense into BERTcited by 73
- 2020ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learningcited by 72
- 2020MLMLM: Link Prediction with Mean Likelihood Masked Language Modelcited by 22
- 2020Context-Aware Answer Extraction in Question Answeringcited by 13
- 2020KgPLM: Knowledge-guided Language Model Pre-training via Generative and Discriminative Learningcited by 9
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 3.
5 papers.
- 2025MCIF: Multimodal Crosslingual Instruction-Following Benchmark from Scientific Talkscited by 14
- 2025Understanding LLMs' Cross-Lingual Context Retrieval: How Good It Is And Where It Comes Fromcited by 4
- 2023Promoting Generalized Cross-lingual Question Answering in Few-resource Scenarios via Self-knowledge Distillationcited by 1
- 2025COMM:Concentrated Margin Maximization for Robust Document-Level Relation Extractioncited by 1
- 2024SandboxAQ's submission to MRL 2024 Shared Task on Multi-lingual Multi-task Information Retrievalcited by 0
- 2025MCIF: Multimodal Crosslingual Instruction-Following Benchmark from Scientific Talks25 Jul 2025
- 2025Understanding LLMs' Cross-Lingual Context Retrieval: How Good It Is And Where It Comes From15 Apr 2025
- 2025COMM:Concentrated Margin Maximization for Robust Document-Level Relation Extraction18 Mar 2025
- 2024SandboxAQ's submission to MRL 2024 Shared Task on Multi-lingual Multi-task Information Retrieval28 Oct 2024
- 2023Promoting Generalized Cross-lingual Question Answering in Few-resource Scenarios via Self-knowledge Distillation29 Sep 2023
Similar, not cited
Close in wording, no citation either way
- 2021Investigating Post-pretraining Representation Alignment for Cross-Lingual Question Answering
- 2026RespondeoQA: a Benchmark for Bilingual Latin-English Question Answering
- 2024The Power of Question Translation Training in Multilingual Reasoning: Broadened Scope and Deepened Insights
- 2026Do Language Models Reason Across Languages?
- 2025CALM: Unleashing the Cross-Lingual Self-Aligning Ability of Language Model Question Answering
- 2026XHotpotQA: A Benchmark for Cross-Lingual Knowledge Composition in Multi-Hop Question Answering
- 2023Cross-lingual QA: A Key to Unlocking In-context Cross-lingual Performance
- 2025M3TQA: Massively Multilingual Multitask Table Question Answering