Cross Lingual Speech Emotion Recognition: Urdu vs. Western Languages
Not on the map. Why?
Abstract (arXiv)
Cross-lingual speech emotion recognition is an important task for practical applications. The performance of automatic speech emotion recognition systems degrades in cross-corpus scenarios, particularly in scenarios involving multiple languages or a previously unseen language such as Urdu for which limited or no data is available. In this study, we investigate the problem of cross-lingual emotion recognition for Urdu language and contribute URDU---the first ever spontaneous Urdu-language speech emotion database. Evaluations are performed using three different Western languages against Urdu and experimental results on different possible scenarios suggest various interesting aspects for designing more adaptive emotion recognition system for such limited languages. In results, selecting training instances of multiple languages can deliver comparable results to baseline and augmentation a fraction of testing language data while training can help to boost accuracy for speech emotion recognition. URDU data is publicly available for further research.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 1; 2023: 6; 2024: 7; 2025: 8; 2026: 1.
25 papers.
Sort:
By area:
- 2023emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representationcited by 196
- 2024EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmarkcited by 39
- 2024MEMO: Memory-Guided Diffusion for Expressive Talking Video Generationcited by 38
- 2025Are LLMs Empathetic to All? Investigating the Influence of Multi-Demographic Personas on a Model's Empathycited by 9
- 2024SER Evals: In-domain and Out-of-domain Benchmarking for Speech Emotion Recognitioncited by 6
- 2023A Comprehensive Review on Sentiment Analysis: Tasks, Approaches and Applicationscited by 3
- 2024nEMO: Dataset of Emotional Speech in Polishcited by 3
- 2024Cross-Lingual Speech Emotion Recognition: Humans vs. Self-Supervised Modelscited by 3
- 2023Towards Generalizable SER: Soft Labeling and Data Augmentation for Modeling Temporal Emotion Shifts in Large-Scale Multilingual Speechcited by 2
- 2025Learning More with Less: Self-Supervised Approaches for Low-Resource Speech Emotion Recognitioncited by 2
- 2025Anatomy-Guided Representation Learning Using a Transformer-Based Network for Thyroid Nodule Segmentation in Ultrasound Imagescited by 2
- 2026VoxEmo: Benchmarking Speech Emotion Recognition with Speech LLMscited by 2
13 more
- 2021Transfer learning from High-Resource to Low-Resource Language Improves Speech Affect Recognition Classification Accuracycited by 1
- 2022Sentiment recognition of Italian elderly through domain adaptation on cross-corpus speech datasetcited by 1
- 2023Cross-Language Speech Emotion Recognition Using Multimodal Dual Attention Transformerscited by 1
- 2023Cross-Corpus Multilingual Speech Emotion Recognition: Amharic vs. Other Languagescited by 1
- 2024Are Paralinguistic Representations all that is needed for Speech Emotion Recognition?cited by 1
- 2025Complex Swin Transformer for Accelerating Enhanced SMWI Reconstructioncited by 1
- 2021Transfer Learning based Speech Affect Recognition in Urducited by 0
- 2023SER_AMPEL: a multi-source dataset for speech emotion recognition of Italian older adultscited by 0
- 2024Multi-Task Adversarial Variational Autoencoder for Estimating Biological Brain Age with Multimodal Neuroimagingcited by 0
- 2025Leveraging Cross-Attention Transformer and Multi-Feature Fusion for Cross-Linguistic Speech Emotion Recognitioncited by 0
- 2025EmoTale: An Enacted Speech-emotion Dataset in Danishcited by 0
- 2025Cross-Corpus Validation of Speech Emotion Recognition in Urdu using Domain-Knowledge Acoustic Featurescited by 0
- 2025Dual-Encoder Transformer-Based Multimodal Learning for Ischemic Stroke Lesion Segmentation Using Diffusion MRIcited by 0
- 2026VoxEmo: Benchmarking Speech Emotion Recognition with Speech LLMs9 Mar 2026
- 2025Dual-Encoder Transformer-Based Multimodal Learning for Ischemic Stroke Lesion Segmentation Using Diffusion MRI23 Dec 2025
- 2025Complex Swin Transformer for Accelerating Enhanced SMWI Reconstruction21 Dec 2025
- 2025Anatomy-Guided Representation Learning Using a Transformer-Based Network for Thyroid Nodule Segmentation in Ultrasound Images14 Dec 2025
- 2025Cross-Corpus Validation of Speech Emotion Recognition in Urdu using Domain-Knowledge Acoustic Features28 Oct 2025
- 2025Are LLMs Empathetic to All? Investigating the Influence of Multi-Demographic Personas on a Model's Empathy11 Oct 2025
- 2025EmoTale: An Enacted Speech-emotion Dataset in Danish20 Aug 2025
- 2025Learning More with Less: Self-Supervised Approaches for Low-Resource Speech Emotion Recognition1 Jun 2025
- 2025Leveraging Cross-Attention Transformer and Multi-Feature Fusion for Cross-Linguistic Speech Emotion Recognition6 Jan 2025
- 2024MEMO: Memory-Guided Diffusion for Expressive Talking Video Generation5 Dec 2024
- 2024Multi-Task Adversarial Variational Autoencoder for Estimating Biological Brain Age with Multimodal Neuroimaging15 Nov 2024
- 2024Cross-Lingual Speech Emotion Recognition: Humans vs. Self-Supervised Models25 Sep 2024
13 more
- 2024SER Evals: In-domain and Out-of-domain Benchmarking for Speech Emotion Recognition14 Aug 2024
- 2024EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark11 Jun 2024
- 2024nEMO: Dataset of Emotional Speech in Polish9 Apr 2024
- 2024Are Paralinguistic Representations all that is needed for Speech Emotion Recognition?2 Feb 2024
- 2023emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation23 Dec 2023
- 2023SER_AMPEL: a multi-source dataset for speech emotion recognition of Italian older adults24 Nov 2023
- 2023A Comprehensive Review on Sentiment Analysis: Tasks, Approaches and Applications19 Nov 2023
- 2023Towards Generalizable SER: Soft Labeling and Data Augmentation for Modeling Temporal Emotion Shifts in Large-Scale Multilingual Speech15 Nov 2023
- 2023Cross-Corpus Multilingual Speech Emotion Recognition: Amharic vs. Other Languages20 Jul 2023
- 2023Cross-Language Speech Emotion Recognition Using Multimodal Dual Attention Transformers23 Jun 2023
- 2022Sentiment recognition of Italian elderly through domain adaptation on cross-corpus speech dataset14 Nov 2022
- 2021Transfer Learning based Speech Affect Recognition in Urdu5 Mar 2021
- 2021Transfer learning from High-Resource to Low-Resource Language Improves Speech Affect Recognition Classification Accuracy4 Mar 2021
- 2023emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representationcited by 196
- 2024EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmarkcited by 39
- 2025Are LLMs Empathetic to All? Investigating the Influence of Multi-Demographic Personas on a Model's Empathycited by 9
- 2024SER Evals: In-domain and Out-of-domain Benchmarking for Speech Emotion Recognitioncited by 6
- 2023A Comprehensive Review on Sentiment Analysis: Tasks, Approaches and Applicationscited by 3
- 2024nEMO: Dataset of Emotional Speech in Polishcited by 3
- 2024Cross-Lingual Speech Emotion Recognition: Humans vs. Self-Supervised Modelscited by 3
- 2023Towards Generalizable SER: Soft Labeling and Data Augmentation for Modeling Temporal Emotion Shifts in Large-Scale Multilingual Speechcited by 2
- 2025Learning More with Less: Self-Supervised Approaches for Low-Resource Speech Emotion Recognitioncited by 2
- 2025Anatomy-Guided Representation Learning Using a Transformer-Based Network for Thyroid Nodule Segmentation in Ultrasound Imagescited by 2
- 2026VoxEmo: Benchmarking Speech Emotion Recognition with Speech LLMscited by 2
- 2021Transfer learning from High-Resource to Low-Resource Language Improves Speech Affect Recognition Classification Accuracycited by 1
12 most cited of 24 All 24 (JSON)
- 2026VoxEmo: Benchmarking Speech Emotion Recognition with Speech LLMs9 Mar 2026
- 2025Dual-Encoder Transformer-Based Multimodal Learning for Ischemic Stroke Lesion Segmentation Using Diffusion MRI23 Dec 2025
- 2025Complex Swin Transformer for Accelerating Enhanced SMWI Reconstruction21 Dec 2025
- 2025Anatomy-Guided Representation Learning Using a Transformer-Based Network for Thyroid Nodule Segmentation in Ultrasound Images14 Dec 2025
- 2025Cross-Corpus Validation of Speech Emotion Recognition in Urdu using Domain-Knowledge Acoustic Features28 Oct 2025
- 2025Are LLMs Empathetic to All? Investigating the Influence of Multi-Demographic Personas on a Model's Empathy11 Oct 2025
- 2025EmoTale: An Enacted Speech-emotion Dataset in Danish20 Aug 2025
- 2025Learning More with Less: Self-Supervised Approaches for Low-Resource Speech Emotion Recognition1 Jun 2025
- 2025Leveraging Cross-Attention Transformer and Multi-Feature Fusion for Cross-Linguistic Speech Emotion Recognition6 Jan 2025
- 2024Multi-Task Adversarial Variational Autoencoder for Estimating Biological Brain Age with Multimodal Neuroimaging15 Nov 2024
- 2024Cross-Lingual Speech Emotion Recognition: Humans vs. Self-Supervised Models25 Sep 2024
- 2024SER Evals: In-domain and Out-of-domain Benchmarking for Speech Emotion Recognition14 Aug 2024
12 newest of 24 All 24 (JSON)