mlsanityData to 14 Oct 2026

Extracting Lexical Features from Dialects via Interpretable Dialect Classifiers

arXiv 2402.17914 ↗First posted 27 Feb 2024cs.CL cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Identifying linguistic differences between dialects of a language often requires expert knowledge and meticulous human analysis. This is largely due to the complexity and nuance involved in studying various dialects. We present a novel approach to extract distinguishing lexical features of dialects by utilizing interpretable dialect classifiers, even in the absence of human experts. We explore both post-hoc and intrinsic approaches to interpretability, conduct experiments on Mandarin, Italian, and Low Saxon, and experimentally demonstrate that our method successfully identifies key language-specific lexical features that contribute to dialectal variations.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 19 of its 38 references that are in the map. First posted on arXiv 27 Feb 2024.

Builds on

19 of 38 references.

References · 19

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  2. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  3. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  4. 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
  5. 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
  6. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
  7. 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
  8. 2019Rethinking Cooperative Rationalization: Introspective Extraction and Complement Controlcited by 96
  9. 2019Automated Rationale Generation: A Technique for Explainable AI and its Effects on Human Perceptionscited by 81
  10. 2021SelfExplain: A Self-Explaining Architecture for Neural Text Classifierscited by 44
  11. 2018Automatic Language Identification in Texts: A Surveycited by 41
  12. 2018Understanding Convolutional Neural Networks for Text Classificationcited by 36
7 more
  1. 2020Learning to Recognize Dialect Featurescited by 29
  2. 2019Towards Hierarchical Importance Attribution: Explaining Compositional Semantics for Neural Sequence Modelscited by 26
  3. 2022FRMT: A Benchmark for Few-Shot Region-Aware Machine Translationcited by 18
  4. 2023Findings of the VarDial Evaluation Campaign 2023cited by 14
  5. 2023Fine-Tuning BERT with Character-Level Noise for Zero-Shot Transfer to Dialects and Closely-Related Languagescited by 9
  6. 2022StyLEx: Explaining Style Using Human Lexical Annotationscited by 3
  7. 2022Syntax-guided Localized Self-attention by Constituency Syntactic Distancecited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 2.

3 papers.