mlsanityData to 7 Oct 2026

Multilingual Relation Classification via Efficient and Effective Prompting

arXiv 2210.13838 ↗First posted 25 Oct 2022cs.CL cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

Prompting pre-trained language models has achieved impressive performance on various NLP tasks, especially in low data regimes. Despite the success of prompting in monolingual settings, applying prompt-based methods in multilingual scenarios has been limited to a narrow set of tasks, due to the high cost of handcrafting multilingual prompts. In this paper, we present the first work on prompt-based multilingual relation classification (RC), by introducing an efficient and effective method that constructs prompts from relation triples and involves only minimal translation for the class labels. We evaluate its performance in fully supervised, few-shot and zero-shot scenarios, and analyze its effectiveness across 14 languages, prompt variants, and English-task training in cross-lingual settings. We find that in both fully supervised and few-shot scenarios, our prompt method beats competitive baselines: fine-tuning XLM-R_EM and null prompts. It also outperforms the random baseline by a large margin in zero-shot experiments. Our method requires little in-language knowledge and can be used as a strong baseline for similar multilingual classification tasks.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 43 of its 68 references that are in the map. First posted on arXiv 25 Oct 2022.

Builds on

43 of 68 references.

References · 43

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  6. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  7. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  8. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  9. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
  10. 2019Language Models as Knowledge Bases?cited by 1,922
  11. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  12. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
31 more
  1. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  2. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
  3. 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,041
  4. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
  5. 2018Neural Network Acceptability Judgmentscited by 952
  6. 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 913
  7. 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
  8. 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 271
  9. 2019PAWS-X: A Cross-lingual Adversarial Dataset for Paraphrase Identificationcited by 262
  10. 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
  11. 2021PPT: Pre-trained Prompt Tuning for Few-shot Learningcited by 232
  12. 2021How Many Data Points is a Prompt Worth?cited by 197
  13. 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
  14. 2021Template-Based Named Entity Recognition Using BARTcited by 153
  15. 2020The Multilingual Amazon Reviews Corpuscited by 142
  16. 2021Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Modelscited by 139
  17. 2022CLIP Models are Few-shot Learners: Empirical Studies on VQA and Visual Entailmentcited by 113
  18. 2021Language Models are Few-shot Multilingual Learnerscited by 92
  19. 2022NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languagescited by 67
  20. 2022One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesiacited by 65
  21. 2018A Hierarchical Multi-task Approach for Learning Embeddings from Semantic Taskscited by 54
  22. 2021Discrete and Soft Prompting for Multilingual Modelscited by 49
  23. 2019Fine-tuning Pre-Trained Transformer Language Models to Distantly Supervised Relation Extractioncited by 36
  24. 2021Relation Classification with Entity Type Restrictioncited by 31
  25. 2021Multilingual Code-Switching for Zero-Shot Cross-Lingual Intent Prediction and Slot Fillingcited by 25
  26. 2022Zero-shot Cross-lingual Transfer of Prompt-based Tuning with a Unified Multilingual Promptcited by 25
  27. 2020The RELX Dataset and Matching the Multilingual Blanks for Cross-Lingual Relation Classificationcited by 13
  28. 2022Generative Prompt Tuning for Relation Classificationcited by 13
  29. 2021A Data Bootstrapping Recipe for Low Resource Multilingual Relation Classificationcited by 8
  30. 2015Multilingual Open Relation Extraction Using Cross-lingual Projectioncited by 7
  31. 2022Downstream Transformer Generation of Question-Answer Pairs with Preprocessing and Postprocessing Pipelinescited by 5

Built on by

Cited by year

Citing papers per year: 2023: 5; 2024: 1; 2025: 1.

7 papers.