Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question Answering
Not on the map. Why?
Abstract (arXiv)
Coupled with the availability of large scale datasets, deep learning architectures have enabled rapid progress on the Question Answering task. However, most of those datasets are in English, and the performances of state-of-the-art multilingual models are significantly lower when evaluated on non-English data. Due to high data collection costs, it is not realistic to obtain annotated data for each language one desires to support. We propose a method to improve the Cross-lingual Question Answering performance without requiring additional annotated data, leveraging Question Generation models to produce synthetic samples in a cross-lingual fashion. We show that the proposed method allows to significantly outperform the baselines trained on English data only. We report a new state-of-the-art on four multilingual datasets: MLQA, XQuAD, SQuAD-it and PIAF (fr).
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 10; 2023: 8; 2024: 9; 2025: 5; 2026: 5.
41 papers.
Sort:
By area:
- 2021A Survey of Data Augmentation Approaches for NLPcited by 408
- 2022Fine-tuned Language Models are Continual Learnerscited by 152
- 2024Best Practices and Lessons Learned on Synthetic Datacited by 104
- 2021Data Augmentation Approaches in Natural Language Processing: A Surveycited by 82
- 2022Generating Scientific Claims for Zero-Shot Scientific Fact Checkingcited by 59
- 2021One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrievalcited by 46
- 2022QAmeleon: Multilingual QA with Only 5 Examplescited by 25
- 2024DataGen: Unified Synthetic Dataset Generation via Large Language Modelscited by 22
- 2022IT5: Text-to-text Pretraining for Italian Language Understanding and Generationcited by 20
- 2023Camoscio: an Italian Instruction-tuned LLaMAcited by 13
- 2023PAXQA: Generating Cross-lingual Question Answering Examples at Training Scalecited by 10
- 2023Can LLMs Augment Low-Resource Reading Comprehension Datasets? Opportunities and Challengescited by 9
29 more
- 2025CODESYNC: Synchronizing Large Language Models with Dynamic Code Evolution at Scalecited by 8
- 2025AskQE: Question Answering as Automatic Evaluation for Machine Translationcited by 7
- 2021Cross-Lingual Open-Domain Question Answering with Answer Sentence Generationcited by 6
- 2022The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot Transfercited by 5
- 2022IDK-MRC: Unanswerable Questions for Indonesian Machine Reading Comprehensioncited by 4
- 2023CCT-Code: Cross-Consistency Training for Multilingual Clone Detection and Code Searchcited by 4
- 2026Synthetic Interaction Data for Scalable Personalization in Large Language Modelscited by 4
- 2022MaskEval: Weighted MLM-Based Evaluation for Text Summarization and Simplificationcited by 3
- 2024GeMQuAD : Generating Multilingual Question Answering Datasets from Large Language Models using Few Shot Learningcited by 3
- 2025ChemOrch: Empowering LLMs with Chemical Intelligence via Synthetic Instructionscited by 3
- 2023Interpreting Indirect Answers to Yes-No Questions in Multiple Languagescited by 2
- 2025QUARTZ : QA-based Unsupervised Abstractive Refinement for Task-oriented Dialogue Summarizationcited by 2
- 2022ZusammenQA: Data Augmentation with Specialized Models for Cross-lingual Open-retrieval Question Answering Systemcited by 1
- 2022Neural Data-to-Text Generation Based on Small Datasets: Comparing the Added Value of Two Semi-Supervised Learning Approaches on Top of a Large Language Modelcited by 1
- 2023Cross-Lingual Question Answering over Knowledge Base as Reading Comprehensioncited by 1
- 2023Promoting Generalized Cross-lingual Question Answering in Few-resource Scenarios via Self-knowledge Distillationcited by 1
- 2024Zero-shot Cross-lingual Stance Detection via Adversarial Language Adaptationcited by 1
- 2024QOG:Question and Options Generation based on Language Modelcited by 1
- 2024SynDARin: Synthesising Datasets for Automated Reasoning in Low-Resource Languagescited by 1
- 2025Semantic Bridge: Universal Multi-Hop Question Generation via AMR-Driven Graph Synthesiscited by 1
- 2026Learning from Synthetic Data without Model Collapse in Iterative Instruction Tuningcited by 1
- 2022Discriminative Models Can Still Outperform Generative Models in Aspect Based Sentiment Analysiscited by 0
- 2023Cross-lingual Data Augmentation for Document-grounded Dialog Systems in Low Resource Languagescited by 0
- 2024UniPSDA: Unsupervised Pseudo Semantic Data Augmentation for Zero-Shot Cross-Lingual Natural Language Understandingcited by 0
- 2024Boosting Zero-Shot Crosslingual Performance using LLM-Based Augmentations with Effective Data Selectioncited by 0
- 2024SandboxAQ's submission to MRL 2024 Shared Task on Multi-lingual Multi-task Information Retrievalcited by 0
- 2026EmbGen: Teaching with Reassembled Corporacited by 0
- 2026Staged Linguistic Seeding: Grounded Query Expansion for Verified-Unit QA in AI Contact Centerscited by 0
- 2026SecProbe: Adaptive Evaluation of Coding Agents on Cybersecurity Vulnerabilitiescited by 0
- 2026SecProbe: Adaptive Evaluation of Coding Agents on Cybersecurity Vulnerabilities27 Sep 2026
- 2026Staged Linguistic Seeding: Grounded Query Expansion for Verified-Unit QA in AI Contact Centers1 Sep 2026
- 2026Learning from Synthetic Data without Model Collapse in Iterative Instruction Tuning19 Jul 2026
- 2026EmbGen: Teaching with Reassembled Corpora19 May 2026
- 2026Synthetic Interaction Data for Scalable Personalization in Large Language Models12 Feb 2026
- 2025QUARTZ : QA-based Unsupervised Abstractive Refinement for Task-oriented Dialogue Summarization30 Sep 2025
- 2025ChemOrch: Empowering LLMs with Chemical Intelligence via Synthetic Instructions20 Sep 2025
- 2025Semantic Bridge: Universal Multi-Hop Question Generation via AMR-Driven Graph Synthesis6 Aug 2025
- 2025AskQE: Question Answering as Automatic Evaluation for Machine Translation15 Apr 2025
- 2025CODESYNC: Synchronizing Large Language Models with Dynamic Code Evolution at Scale23 Feb 2025
- 2024SandboxAQ's submission to MRL 2024 Shared Task on Multi-lingual Multi-task Information Retrieval28 Oct 2024
- 2024Boosting Zero-Shot Crosslingual Performance using LLM-Based Augmentations with Effective Data Selection15 Jul 2024
29 more
- 2024DataGen: Unified Synthetic Dataset Generation via Large Language Models27 Jun 2024
- 2024UniPSDA: Unsupervised Pseudo Semantic Data Augmentation for Zero-Shot Cross-Lingual Natural Language Understanding24 Jun 2024
- 2024SynDARin: Synthesising Datasets for Automated Reasoning in Low-Resource Languages20 Jun 2024
- 2024QOG:Question and Options Generation based on Language Model18 Jun 2024
- 2024Zero-shot Cross-lingual Stance Detection via Adversarial Language Adaptation22 Apr 2024
- 2024GeMQuAD : Generating Multilingual Question Answering Datasets from Large Language Models using Few Shot Learning14 Apr 2024
- 2024Best Practices and Lessons Learned on Synthetic Data11 Apr 2024
- 2023Interpreting Indirect Answers to Yes-No Questions in Multiple Languages20 Oct 2023
- 2023Promoting Generalized Cross-lingual Question Answering in Few-resource Scenarios via Self-knowledge Distillation29 Sep 2023
- 2023Can LLMs Augment Low-Resource Reading Comprehension Datasets? Opportunities and Challenges21 Sep 2023
- 2023Camoscio: an Italian Instruction-tuned LLaMA31 Jul 2023
- 2023Cross-lingual Data Augmentation for Document-grounded Dialog Systems in Low Resource Languages24 May 2023
- 2023CCT-Code: Cross-Consistency Training for Multilingual Clone Detection and Code Search19 May 2023
- 2023PAXQA: Generating Cross-lingual Question Answering Examples at Training Scale24 Apr 2023
- 2023Cross-Lingual Question Answering over Knowledge Base as Reading Comprehension26 Feb 2023
- 2022QAmeleon: Multilingual QA with Only 5 Examples15 Nov 2022
- 2022IDK-MRC: Unanswerable Questions for Indonesian Machine Reading Comprehension25 Oct 2022
- 2022Neural Data-to-Text Generation Based on Small Datasets: Comparing the Added Value of Two Semi-Supervised Learning Approaches on Top of a Large Language Model14 Jul 2022
- 2022Discriminative Models Can Still Outperform Generative Models in Aspect Based Sentiment Analysis6 Jun 2022
- 2022ZusammenQA: Data Augmentation with Specialized Models for Cross-lingual Open-retrieval Question Answering System30 May 2022
- 2022MaskEval: Weighted MLM-Based Evaluation for Text Summarization and Simplification24 May 2022
- 2022Fine-tuned Language Models are Continual Learners24 May 2022
- 2022The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot Transfer13 Apr 2022
- 2022Generating Scientific Claims for Zero-Shot Scientific Fact Checking24 Mar 2022
- 2022IT5: Text-to-text Pretraining for Italian Language Understanding and Generation7 Mar 2022
- 2021Cross-Lingual Open-Domain Question Answering with Answer Sentence Generation14 Oct 2021
- 2021Data Augmentation Approaches in Natural Language Processing: A Survey5 Oct 2021
- 2021One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrieval26 Jul 2021
- 2021A Survey of Data Augmentation Approaches for NLP7 May 2021
- 2024Best Practices and Lessons Learned on Synthetic Datacited by 104
- 2024DataGen: Unified Synthetic Dataset Generation via Large Language Modelscited by 22
- 2025ChemOrch: Empowering LLMs with Chemical Intelligence via Synthetic Instructionscited by 3
- 2026Learning from Synthetic Data without Model Collapse in Iterative Instruction Tuningcited by 1
- 2026Learning from Synthetic Data without Model Collapse in Iterative Instruction Tuning19 Jul 2026
- 2025ChemOrch: Empowering LLMs with Chemical Intelligence via Synthetic Instructions20 Sep 2025
- 2024DataGen: Unified Synthetic Dataset Generation via Large Language Models27 Jun 2024
- 2024Best Practices and Lessons Learned on Synthetic Data11 Apr 2024
- 2021A Survey of Data Augmentation Approaches for NLPcited by 408
- 2022Fine-tuned Language Models are Continual Learnerscited by 152
- 2021Data Augmentation Approaches in Natural Language Processing: A Surveycited by 82
- 2022Generating Scientific Claims for Zero-Shot Scientific Fact Checkingcited by 59
- 2021One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrievalcited by 46
- 2022QAmeleon: Multilingual QA with Only 5 Examplescited by 25
- 2022IT5: Text-to-text Pretraining for Italian Language Understanding and Generationcited by 20
- 2023Camoscio: an Italian Instruction-tuned LLaMAcited by 13
- 2023PAXQA: Generating Cross-lingual Question Answering Examples at Training Scalecited by 10
- 2023Can LLMs Augment Low-Resource Reading Comprehension Datasets? Opportunities and Challengescited by 9
- 2025AskQE: Question Answering as Automatic Evaluation for Machine Translationcited by 7
- 2021Cross-Lingual Open-Domain Question Answering with Answer Sentence Generationcited by 6
12 most cited of 34 All 34 (JSON)
- 2026Staged Linguistic Seeding: Grounded Query Expansion for Verified-Unit QA in AI Contact Centers1 Sep 2026
- 2026EmbGen: Teaching with Reassembled Corpora19 May 2026
- 2026Synthetic Interaction Data for Scalable Personalization in Large Language Models12 Feb 2026
- 2025QUARTZ : QA-based Unsupervised Abstractive Refinement for Task-oriented Dialogue Summarization30 Sep 2025
- 2025Semantic Bridge: Universal Multi-Hop Question Generation via AMR-Driven Graph Synthesis6 Aug 2025
- 2025AskQE: Question Answering as Automatic Evaluation for Machine Translation15 Apr 2025
- 2024SandboxAQ's submission to MRL 2024 Shared Task on Multi-lingual Multi-task Information Retrieval28 Oct 2024
- 2024Boosting Zero-Shot Crosslingual Performance using LLM-Based Augmentations with Effective Data Selection15 Jul 2024
- 2024UniPSDA: Unsupervised Pseudo Semantic Data Augmentation for Zero-Shot Cross-Lingual Natural Language Understanding24 Jun 2024
- 2024QOG:Question and Options Generation based on Language Model18 Jun 2024
- 2024Zero-shot Cross-lingual Stance Detection via Adversarial Language Adaptation22 Apr 2024
- 2024GeMQuAD : Generating Multilingual Question Answering Datasets from Large Language Models using Few Shot Learning14 Apr 2024
12 newest of 34 All 34 (JSON)