Extracting Lexical Features from Dialects via Interpretable Dialect Classifiers
Not on the map. Why?
Abstract (arXiv)
Identifying linguistic differences between dialects of a language often requires expert knowledge and meticulous human analysis. This is largely due to the complexity and nuance involved in studying various dialects. We present a novel approach to extract distinguishing lexical features of dialects by utilizing interpretable dialect classifiers, even in the absence of human experts. We explore both post-hoc and intrinsic approaches to interpretability, conduct experiments on Mandarin, Italian, and Low Saxon, and experimentally demonstrate that our method successfully identifies key language-specific lexical features that contribute to dialectal variations.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 19 of its 38 references that are in the map. First posted on arXiv 27 Feb 2024.
Builds on
19 of 38 references.
References · 19
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
- 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
- 2019Rethinking Cooperative Rationalization: Introspective Extraction and Complement Controlcited by 96
- 2019Automated Rationale Generation: A Technique for Explainable AI and its Effects on Human Perceptionscited by 81
- 2021SelfExplain: A Self-Explaining Architecture for Neural Text Classifierscited by 44
- 2018Automatic Language Identification in Texts: A Surveycited by 41
- 2018Understanding Convolutional Neural Networks for Text Classificationcited by 36
7 more
- 2020Learning to Recognize Dialect Featurescited by 29
- 2019Towards Hierarchical Importance Attribution: Explaining Compositional Semantics for Neural Sequence Modelscited by 26
- 2022FRMT: A Benchmark for Few-Shot Region-Aware Machine Translationcited by 18
- 2023Findings of the VarDial Evaluation Campaign 2023cited by 14
- 2023Fine-Tuning BERT with Character-Level Noise for Zero-Shot Transfer to Dialects and Closely-Related Languagescited by 9
- 2022StyLEx: Explaining Style Using Human Lexical Annotationscited by 3
- 2022Syntax-guided Localized Self-attention by Constituency Syntactic Distancecited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 2.
3 papers.
- 2026Right-Wing Rock or Just Rock? A Computational Linguistic Analysis of Frei.Wild30 Sep 2026
- 2026Wiktionary as a Crowdsourced Lexicon for English Dialects16 Aug 2026
- 2024Explainability of machine learning approaches in forensic linguistics: a case study in geolinguistic authorship profiling29 Apr 2024