Multilingual Relation Classification via Efficient and Effective Prompting
Not on the map. Why?
Abstract (arXiv)
Prompting pre-trained language models has achieved impressive performance on various NLP tasks, especially in low data regimes. Despite the success of prompting in monolingual settings, applying prompt-based methods in multilingual scenarios has been limited to a narrow set of tasks, due to the high cost of handcrafting multilingual prompts. In this paper, we present the first work on prompt-based multilingual relation classification (RC), by introducing an efficient and effective method that constructs prompts from relation triples and involves only minimal translation for the class labels. We evaluate its performance in fully supervised, few-shot and zero-shot scenarios, and analyze its effectiveness across 14 languages, prompt variants, and English-task training in cross-lingual settings. We find that in both fully supervised and few-shot scenarios, our prompt method beats competitive baselines: fine-tuning XLM-R_EM and null prompts. It also outperforms the random baseline by a large margin in zero-shot experiments. Our method requires little in-language knowledge and can be used as a strong baseline for similar multilingual classification tasks.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 43 of its 68 references that are in the map. First posted on arXiv 25 Oct 2022.
Builds on
43 of 68 references.
References · 43
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
31 more
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
- 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,041
- 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
- 2018Neural Network Acceptability Judgmentscited by 952
- 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 913
- 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
- 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 271
- 2019PAWS-X: A Cross-lingual Adversarial Dataset for Paraphrase Identificationcited by 262
- 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
- 2021PPT: Pre-trained Prompt Tuning for Few-shot Learningcited by 232
- 2021How Many Data Points is a Prompt Worth?cited by 197
- 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
- 2021Template-Based Named Entity Recognition Using BARTcited by 153
- 2020The Multilingual Amazon Reviews Corpuscited by 142
- 2021Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Modelscited by 139
- 2022CLIP Models are Few-shot Learners: Empirical Studies on VQA and Visual Entailmentcited by 113
- 2021Language Models are Few-shot Multilingual Learnerscited by 92
- 2022NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languagescited by 67
- 2022One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesiacited by 65
- 2018A Hierarchical Multi-task Approach for Learning Embeddings from Semantic Taskscited by 54
- 2021Discrete and Soft Prompting for Multilingual Modelscited by 49
- 2019Fine-tuning Pre-Trained Transformer Language Models to Distantly Supervised Relation Extractioncited by 36
- 2021Relation Classification with Entity Type Restrictioncited by 31
- 2021Multilingual Code-Switching for Zero-Shot Cross-Lingual Intent Prediction and Slot Fillingcited by 25
- 2022Zero-shot Cross-lingual Transfer of Prompt-based Tuning with a Unified Multilingual Promptcited by 25
- 2020The RELX Dataset and Matching the Multilingual Blanks for Cross-Lingual Relation Classificationcited by 13
- 2022Generative Prompt Tuning for Relation Classificationcited by 13
- 2021A Data Bootstrapping Recipe for Low Resource Multilingual Relation Classificationcited by 8
- 2015Multilingual Open Relation Extraction Using Cross-lingual Projectioncited by 7
- 2022Downstream Transformer Generation of Question-Answer Pairs with Preprocessing and Postprocessing Pipelinescited by 5
Built on by
Citing papers per year: 2023: 5; 2024: 1; 2025: 1.
7 papers.
- 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 203
- 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understandingcited by 29
- 2023CreoleVal: Multilingual Multitask Benchmarks for Creolescited by 9
- 2023REDrm FM: a Filtered and Multilingual Relation Extraction Datasetcited by 6
- 2023MultiTACRED: A Multilingual Version of the TAC Relation Extraction Datasetcited by 5
- 2025Document Intelligence in the Era of Large Language Models: A Surveycited by 5
- 2024Fine-tuning Large Language Models with Limited Data: A Survey and Practical Guidecited by 4
- 2025Document Intelligence in the Era of Large Language Models: A Survey15 Oct 2025
- 2024Fine-tuning Large Language Models with Limited Data: A Survey and Practical Guide14 Nov 2024
- 2023CreoleVal: Multilingual Multitask Benchmarks for Creoles30 Oct 2023
- 2023REDrm FM: a Filtered and Multilingual Relation Extraction Dataset16 Jun 2023
- 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understanding8 Jun 2023
- 2023MultiTACRED: A Multilingual Version of the TAC Relation Extraction Dataset8 May 2023
- 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learning12 Apr 2023