Speech Analysis of Language Varieties in Italy
Not on the map. Why?
Abstract (arXiv)
Italy exhibits rich linguistic diversity across its territory due to the distinct regional languages spoken in different areas. Recent advances in self-supervised learning provide new opportunities to analyze Italy's linguistic varieties using speech data alone. This includes the potential to leverage representations learned from large amounts of data to better examine nuances between closely related linguistic varieties. In this study, we focus on automatically identifying the geographic region of origin of speech samples drawn from Italy's diverse language varieties. We leverage self-supervised learning models to tackle this task and analyze differences and similarities between Italy's regional languages. In doing so, we also seek to uncover new insights into the relationships among these diverse yet closely related varieties, which may help linguists understand their interconnected evolution and regional development over time and space. To improve the discriminative ability of learned representations, we evaluate several supervised contrastive learning objectives, both as pre-training steps and additional fine-tuning objectives. Experimental evidence shows that pre-trained self-supervised models can effectively identify regions from speech recording. Additionally, incorporating contrastive objectives during fine-tuning improves classification accuracy and yields embeddings that distinctly separate regional varieties, demonstrating the value of combining self-supervised pre-training and contrastive learning for this task.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 27 of its 63 references that are in the map. First posted on arXiv 22 Jun 2024.
Builds on
27 of 63 references.
References · 27
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2020Supervised Contrastive Learningcited by 2,829
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
- 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 628
- 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
- 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 501
- 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 476
- 2019Libri-Light: A Benchmark for ASR with Limited or No Supervisioncited by 467
- 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 463
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 406
15 more
- 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 399
- 2019Multi-Similarity Loss with General Pair Weighting for Deep Metric Learningcited by 368
- 2020DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representationscited by 251
- 2020VoxLingua107: a Dataset for Spoken Language Recognitioncited by 122
- 2020CLAR: Contrastive Learning of Auditory Representationscited by 31
- 2023LLaMAntino: LLaMA 2 Models for Effective Text Generation in Italian Languagecited by 25
- 2019Almawave-SLU: A new dataset for SLU in Italiancited by 13
- 2023ITALIC: An Italian Intent Classification Datasetcited by 10
- 2017Continuous Representation of Location for Geolocation and Lexical Dialectology using Mixture Density Networkscited by 8
- 2021Finnish Dialect Identification: The Effect of Audio and Textcited by 8
- 2022Lahjoita puhetta -- a large-scale corpus of spoken Finnish with some benchmarkscited by 7
- 2022Accidental Learners: Spoken Language Identification in Multilingual Self-Supervised Modelscited by 6
- 2023RoDia: A New Dataset for Romanian Dialect Identification from Speechcited by 4
- 2023The 2022 NIST Language Recognition Evaluationcited by 2
- 2023North S'ami Dialect Identification with Self-supervised Speech Modelscited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 2.
3 papers.