Finnish Dialect Identification: The Effect of Audio and Text
Not on the map. Why?
Abstract (arXiv)
Finnish is a language with multiple dialects that not only differ from each other in terms of accent (pronunciation) but also in terms of morphological forms and lexical choice. We present the first approach to automatically detect the dialect of a speaker based on a dialect transcript and transcript with audio recording in a dataset consisting of 23 different dialects. Our results show that the best accuracy is received by combining both of the modalities, as text only reaches to an overall accuracy of 57%, where as text and audio reach to 85%. Our code, models and data have been released openly on Github and Zenodo.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 11 of its 40 references that are in the map. First posted on arXiv 6 Nov 2021.
Builds on
11 of 40 references.
References · 11
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
- 2017OpenNMT: Open-source Toolkit for Neural Machine Translationcited by 251
- 2019Multilingual is not enough: BERT for Finnishcited by 119
- 2019CSS10: A Collection of Single Speaker Speech Datasets for 10 Languagescited by 54
- 2020Multi-Dialect Arabic BERT for Country-Level Dialect Identificationcited by 15
- 2020Automatic Dialect Adaptation in Finnish and its Effect on Perceived Creativitycited by 5
- 2021Lemmatization of Historical Old Literary Finnish Texts in Modern Orthographycited by 5
- 2020Dialect Identification of Spoken North S'ami Language Varieties Using Prosodic Featurescited by 3
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 2; 2024: 3; 2025: 1.
8 papers.
- 2024DIALECTBENCH: A NLP Benchmark for Dialects, Varieties, and Closely-Related Languagescited by 50
- 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
- 2022Lahjoita puhetta -- a large-scale corpus of spoken Finnish with some benchmarkscited by 7
- 2023RoDia: A New Dataset for Romanian Dialect Identification from Speechcited by 4
- 2025The ML-SUPERB 2.0 Challenge: Towards Inclusive ASR Benchmarking for All Language Varietiescited by 4
- 2024Speech Analysis of Language Varieties in Italycited by 3
- 2021Processing M.A. Castr'en's Materials: Multilingual Typed and Handwritten Manuscriptscited by 1
- 2023Unsupervised Out-of-Distribution Dialect Detection with Mahalanobis Distancecited by 1
- 2025The ML-SUPERB 2.0 Challenge: Towards Inclusive ASR Benchmarking for All Language Varieties8 Sep 2025
- 2024Speech Analysis of Language Varieties in Italy22 Jun 2024
- 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Art6 Jun 2024
- 2024DIALECTBENCH: A NLP Benchmark for Dialects, Varieties, and Closely-Related Languages16 Mar 2024
- 2023RoDia: A New Dataset for Romanian Dialect Identification from Speech6 Sep 2023
- 2023Unsupervised Out-of-Distribution Dialect Detection with Mahalanobis Distance9 Aug 2023
- 2022Lahjoita puhetta -- a large-scale corpus of spoken Finnish with some benchmarks24 Mar 2022
- 2021Processing M.A. Castr'en's Materials: Multilingual Typed and Handwritten Manuscripts28 Dec 2021