Findings of the VarDial Evaluation Campaign 2023
Not on the map. Why?
Abstract (arXiv)
This report presents the results of the shared tasks organized as part of the VarDial Evaluation Campaign 2023. The campaign is part of the tenth workshop on Natural Language Processing (NLP) for Similar Languages, Varieties and Dialects (VarDial), co-located with EACL 2023. Three separate shared tasks were included this year: Slot and intent detection for low-resource language varieties (SID4LR), Discriminating Between Similar Languages -- True Labels (DSL-TL), and Discriminating Between Similar Languages -- Speech (DSL-S). All three tasks were organized for the first time this year.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 22 of its 50 references that are in the map. First posted on arXiv 31 May 2023.
Builds on
22 of 50 references.
References · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,488
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
- 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
- 2019Defending Against Neural Fake Newscited by 559
- 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 501
- 2018Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfacescited by 377
- 2018Cross-Lingual Transfer Learning for Multilingual Task Oriented Dialogcited by 125
- 2020Massive Choice, Ample Tasks (MaChAmp): A Toolkit for Multi-task Learning in NLPcited by 50
10 more
- 2021From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understandingcited by 43
- 2018Automatic Language Identification in Texts: A Surveycited by 41
- 2022BERTIN: Efficient Pre-Training of a Spanish Language Model using Perplexity Samplingcited by 30
- 2021Improving Zero-shot Cross-lingual Transfer between Closely Related Languages by injecting Character-level Noisecited by 19
- 2023Language Variety Identification with True Labelscited by 12
- 2023Fine-Tuning BERT with Character-Level Noise for Zero-Shot Transfer to Dialects and Closely-Related Languagescited by 9
- 2016Discriminating Similar Languages: Evaluations and Explorationscited by 6
- 2022Accidental Learners: Spoken Language Identification in Multilingual Self-Supervised Modelscited by 6
- 2023Zero-Shot Slot and Intent Detection in Low-Resource Languagescited by 4
- 2023Two-stage Pipeline for Multilingual Dialect Detectioncited by 3
Built on by
Citing papers per year: 2024: 7; 2025: 3; 2026: 4.
14 papers.
Sort:
- 2024Natural Language Processing for Dialects of a Language: A Surveycited by 40
- 2024Evaluating Pixel Language Models on Non-Standardized Languagescited by 10
- 2026OpenLID-v3: Improving the Precision of Closely Related Language Identification -- An Experience Reportcited by 5
- 2024Exploring the Robustness of Task-oriented Dialogue Systems for Colloquial German Varietiescited by 4
- 2024Extracting Lexical Features from Dialects via Interpretable Dialect Classifierscited by 3
- 2024Common Ground, Diverse Roots: The Difficulty of Classifying Common Examples in Spanish Varietiescited by 3
- 2025Improving Dialectal Slot and Intent Detection with Auxiliary Tasks: A Multi-Dialectal Bavarian Case Studycited by 3
- 2025Add Noise, Tasks, or Layers? MaiNLP at the VarDial 2025 Shared Task on Norwegian Dialectal Slot and Intent Detectioncited by 2
- 2025Standard-to-Dialect Transfer Trends Differ across Text and Speech: A Case Study on Intent and Topic Classification in German Dialectscited by 2
- 2024HiTZ at VarDial 2025 NorSID: Overcoming Data Scarcity with Language Transfer and Automatic Data Annotationcited by 1
- 2026P3B3: A Multi-Turn Conversational Benchmark for Measuring European and Brazilian Portuguese Variety Bias in LLMscited by 1
- 2024Human-LLM Collaborative Construction of a Cantonese Emotion Lexiconcited by 0
- 2026Different Perturbations, Different Mechanisms: Understanding Continued Pre-training for Zero-Shot Dialect Robustness6 Aug 2026
- 2026P3B3: A Multi-Turn Conversational Benchmark for Measuring European and Brazilian Portuguese Variety Bias in LLMs15 Jun 2026
- 2026OpenLID-v3: Improving the Precision of Closely Related Language Identification -- An Experience Report13 Feb 2026
- 2026How Should We Model the Probability of a Language?9 Feb 2026
- 2025Standard-to-Dialect Transfer Trends Differ across Text and Speech: A Case Study on Intent and Topic Classification in German Dialects9 Oct 2025
- 2025Add Noise, Tasks, or Layers? MaiNLP at the VarDial 2025 Shared Task on Norwegian Dialectal Slot and Intent Detection7 Jan 2025
- 2025Improving Dialectal Slot and Intent Detection with Auxiliary Tasks: A Multi-Dialectal Bavarian Case Study7 Jan 2025
- 2024Common Ground, Diverse Roots: The Difficulty of Classifying Common Examples in Spanish Varieties16 Dec 2024
- 2024HiTZ at VarDial 2025 NorSID: Overcoming Data Scarcity with Language Transfer and Automatic Data Annotation13 Dec 2024
- 2024Evaluating Pixel Language Models on Non-Standardized Languages12 Dec 2024
- 2024Human-LLM Collaborative Construction of a Cantonese Emotion Lexicon15 Oct 2024
- 2024Extracting Lexical Features from Dialects via Interpretable Dialect Classifiers27 Feb 2024
- 2024Natural Language Processing for Dialects of a Language: A Surveycited by 40
- 2024Evaluating Pixel Language Models on Non-Standardized Languagescited by 10
- 2026OpenLID-v3: Improving the Precision of Closely Related Language Identification -- An Experience Reportcited by 5
- 2024Exploring the Robustness of Task-oriented Dialogue Systems for Colloquial German Varietiescited by 4
- 2024Extracting Lexical Features from Dialects via Interpretable Dialect Classifierscited by 3
- 2024Common Ground, Diverse Roots: The Difficulty of Classifying Common Examples in Spanish Varietiescited by 3
- 2025Improving Dialectal Slot and Intent Detection with Auxiliary Tasks: A Multi-Dialectal Bavarian Case Studycited by 3
- 2025Add Noise, Tasks, or Layers? MaiNLP at the VarDial 2025 Shared Task on Norwegian Dialectal Slot and Intent Detectioncited by 2
- 2025Standard-to-Dialect Transfer Trends Differ across Text and Speech: A Case Study on Intent and Topic Classification in German Dialectscited by 2
- 2024HiTZ at VarDial 2025 NorSID: Overcoming Data Scarcity with Language Transfer and Automatic Data Annotationcited by 1
- 2026P3B3: A Multi-Turn Conversational Benchmark for Measuring European and Brazilian Portuguese Variety Bias in LLMscited by 1
- 2024Human-LLM Collaborative Construction of a Cantonese Emotion Lexiconcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Different Perturbations, Different Mechanisms: Understanding Continued Pre-training for Zero-Shot Dialect Robustness6 Aug 2026
- 2026P3B3: A Multi-Turn Conversational Benchmark for Measuring European and Brazilian Portuguese Variety Bias in LLMs15 Jun 2026
- 2026OpenLID-v3: Improving the Precision of Closely Related Language Identification -- An Experience Report13 Feb 2026
- 2026How Should We Model the Probability of a Language?9 Feb 2026
- 2025Standard-to-Dialect Transfer Trends Differ across Text and Speech: A Case Study on Intent and Topic Classification in German Dialects9 Oct 2025
- 2025Add Noise, Tasks, or Layers? MaiNLP at the VarDial 2025 Shared Task on Norwegian Dialectal Slot and Intent Detection7 Jan 2025
- 2025Improving Dialectal Slot and Intent Detection with Auxiliary Tasks: A Multi-Dialectal Bavarian Case Study7 Jan 2025
- 2024Common Ground, Diverse Roots: The Difficulty of Classifying Common Examples in Spanish Varieties16 Dec 2024
- 2024HiTZ at VarDial 2025 NorSID: Overcoming Data Scarcity with Language Transfer and Automatic Data Annotation13 Dec 2024
- 2024Evaluating Pixel Language Models on Non-Standardized Languages12 Dec 2024
- 2024Human-LLM Collaborative Construction of a Cantonese Emotion Lexicon15 Oct 2024
- 2024Extracting Lexical Features from Dialects via Interpretable Dialect Classifiers27 Feb 2024
12 newest of 14 All 14 (JSON)