Zero-shot Reading Comprehension by Cross-lingual Transfer Learning with Multi-lingual Language Representation Model
Not on the map. Why?
Abstract (arXiv)
Because it is not feasible to collect training data for every language, there is a growing interest in cross-lingual transfer learning. In this paper, we systematically explore zero-shot cross-lingual transfer learning on reading comprehension tasks with a language representation model pre-trained on multi-lingual corpus. The experimental results show that with pre-trained language representation zero-shot learning is feasible, and translating the source data into the target language is not necessary and even degrades the performance. We further explore what does the model learn in zero-shot setting.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 6; 2023: 4; 2024: 3.
18 papers.
Sort:
- 2021When is BERT Multilingual? Isolating Crucial Ingredients for Cross-lingual Transfercited by 41
- 2022Out of Thin Air: Is Zero-Shot Cross-Lingual Keyword Detection Better Than Unsupervised?cited by 7
- 2022Learning Disentangled Semantic Representations for Zero-Shot Cross-Lingual Transfer in Multilingual Machine Reading Comprehensioncited by 6
- 2022Por Qu'e N~ao Utiliser Alla Spraak? Mixed Training with Gradient Optimization in Few-Shot Cross-Lingual Transfercited by 6
- 2022ALIGN-MLM: Word Embedding Alignment is Crucial for Multilingual Pre-trainingcited by 6
- 2023On Evaluating Multilingual Compositional Generalization with Translated Datasetscited by 6
- 2021Zero-Shot Cross-Lingual Dependency Parsing through Contextual Embedding Transformationcited by 5
- 2022The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot Transfercited by 5
- 2021The Effectiveness of Intermediate-Task Training for Code-Switched Natural Language Understandingcited by 4
- 2021Zero-Shot Cross-Lingual Machine Reading Comprehension via Inter-sentence Dependency Graphcited by 2
- 2023Analysing Cross-Lingual Transfer in Low-Resourced African Named Entity Recognitioncited by 2
- 2023Low-Resource Clickbait Spoiling for Indonesian via Question Answeringcited by 2
6 more
- 2021Improving Cross-Lingual Reading Comprehension with Self-Trainingcited by 1
- 2023Promoting Generalized Cross-lingual Question Answering in Few-resource Scenarios via Self-knowledge Distillationcited by 1
- 2024Incorporating Lexical and Syntactic Knowledge for Unsupervised Cross-Lingual Transfercited by 1
- 2024Evaluating and explaining training strategies for zero-shot cross-lingual news sentiment analysiscited by 1
- 2022An Understanding-Oriented Robust Machine Reading Comprehension Modelcited by 0
- 2024ThaiCoref: Thai Coreference Resolution Datasetcited by 0
- 2024Evaluating and explaining training strategies for zero-shot cross-lingual news sentiment analysis30 Sep 2024
- 2024ThaiCoref: Thai Coreference Resolution Dataset10 Jun 2024
- 2024Incorporating Lexical and Syntactic Knowledge for Unsupervised Cross-Lingual Transfer25 Apr 2024
- 2023Low-Resource Clickbait Spoiling for Indonesian via Question Answering12 Oct 2023
- 2023Promoting Generalized Cross-lingual Question Answering in Few-resource Scenarios via Self-knowledge Distillation29 Sep 2023
- 2023Analysing Cross-Lingual Transfer in Low-Resourced African Named Entity Recognition11 Sep 2023
- 2023On Evaluating Multilingual Compositional Generalization with Translated Datasets20 Jun 2023
- 2022ALIGN-MLM: Word Embedding Alignment is Crucial for Multilingual Pre-training15 Nov 2022
- 2022An Understanding-Oriented Robust Machine Reading Comprehension Model1 Jul 2022
- 2022Por Qu'e N~ao Utiliser Alla Spraak? Mixed Training with Gradient Optimization in Few-Shot Cross-Lingual Transfer29 Apr 2022
- 2022The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot Transfer13 Apr 2022
- 2022Learning Disentangled Semantic Representations for Zero-Shot Cross-Lingual Transfer in Multilingual Machine Reading Comprehension3 Apr 2022
6 more
- 2022Out of Thin Air: Is Zero-Shot Cross-Lingual Keyword Detection Better Than Unsupervised?14 Feb 2022
- 2021Zero-Shot Cross-Lingual Machine Reading Comprehension via Inter-sentence Dependency Graph1 Dec 2021
- 2021When is BERT Multilingual? Isolating Crucial Ingredients for Cross-lingual Transfer27 Oct 2021
- 2021The Effectiveness of Intermediate-Task Training for Code-Switched Natural Language Understanding21 Jul 2021
- 2021Improving Cross-Lingual Reading Comprehension with Self-Training8 May 2021
- 2021Zero-Shot Cross-Lingual Dependency Parsing through Contextual Embedding Transformation3 Mar 2021
- 2021When is BERT Multilingual? Isolating Crucial Ingredients for Cross-lingual Transfercited by 41
- 2022Out of Thin Air: Is Zero-Shot Cross-Lingual Keyword Detection Better Than Unsupervised?cited by 7
- 2022Learning Disentangled Semantic Representations for Zero-Shot Cross-Lingual Transfer in Multilingual Machine Reading Comprehensioncited by 6
- 2022Por Qu'e N~ao Utiliser Alla Spraak? Mixed Training with Gradient Optimization in Few-Shot Cross-Lingual Transfercited by 6
- 2022ALIGN-MLM: Word Embedding Alignment is Crucial for Multilingual Pre-trainingcited by 6
- 2023On Evaluating Multilingual Compositional Generalization with Translated Datasetscited by 6
- 2021Zero-Shot Cross-Lingual Dependency Parsing through Contextual Embedding Transformationcited by 5
- 2022The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot Transfercited by 5
- 2021The Effectiveness of Intermediate-Task Training for Code-Switched Natural Language Understandingcited by 4
- 2021Zero-Shot Cross-Lingual Machine Reading Comprehension via Inter-sentence Dependency Graphcited by 2
- 2023Analysing Cross-Lingual Transfer in Low-Resourced African Named Entity Recognitioncited by 2
- 2023Low-Resource Clickbait Spoiling for Indonesian via Question Answeringcited by 2
12 most cited of 18 All 18 (JSON)
- 2024Evaluating and explaining training strategies for zero-shot cross-lingual news sentiment analysis30 Sep 2024
- 2024ThaiCoref: Thai Coreference Resolution Dataset10 Jun 2024
- 2024Incorporating Lexical and Syntactic Knowledge for Unsupervised Cross-Lingual Transfer25 Apr 2024
- 2023Low-Resource Clickbait Spoiling for Indonesian via Question Answering12 Oct 2023
- 2023Promoting Generalized Cross-lingual Question Answering in Few-resource Scenarios via Self-knowledge Distillation29 Sep 2023
- 2023Analysing Cross-Lingual Transfer in Low-Resourced African Named Entity Recognition11 Sep 2023
- 2023On Evaluating Multilingual Compositional Generalization with Translated Datasets20 Jun 2023
- 2022ALIGN-MLM: Word Embedding Alignment is Crucial for Multilingual Pre-training15 Nov 2022
- 2022An Understanding-Oriented Robust Machine Reading Comprehension Model1 Jul 2022
- 2022Por Qu'e N~ao Utiliser Alla Spraak? Mixed Training with Gradient Optimization in Few-Shot Cross-Lingual Transfer29 Apr 2022
- 2022The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot Transfer13 Apr 2022
- 2022Learning Disentangled Semantic Representations for Zero-Shot Cross-Lingual Transfer in Multilingual Machine Reading Comprehension3 Apr 2022
12 newest of 18 All 18 (JSON)