mlsanityData to 7 Oct 2026

Adapting WavLM for Speech Emotion Recognition

arXiv 2405.04485 ↗First posted 7 May 2024cs.LG cs.SD eess.AScited by 4

Not on the map. Why?

Abstract (arXiv)

Recently, the usage of speech self-supervised models (SSL) for downstream tasks has been drawing a lot of attention. While large pre-trained models commonly outperform smaller models trained from scratch, questions regarding the optimal fine-tuning strategies remain prevalent. In this paper, we explore the fine-tuning strategies of the WavLM Large model for the speech emotion recognition task on the MSP Podcast Corpus. More specifically, we perform a series of experiments focusing on using gender and semantic information from utterances. We then sum up our findings and describe the final model we used for submission to Speech Emotion Recognition Challenge 2024.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 15 of its 31 references that are in the map. First posted on arXiv 7 May 2024.

Builds on

15 of 31 references.

References · 15

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016Layer Normalizationcited by 5,579
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  4. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  5. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  6. 2022data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Languagecited by 718
  7. 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 606
  8. 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 591
  9. 2018Attentive Statistics Pooling for Deep Speaker Embeddingcited by 108
  10. 2022Are All Losses Created Equal: A Neural Collapse Perspectivecited by 78
  11. 2022A Review of Deep Transfer Learning and Recent Advancementscited by 56
  12. 2022Speech Emotion Recognition using Self-Supervised Featurescited by 52
3 more
  1. 2023Vesper: A Compact and Effective Pretrained Model for Speech Emotion Recognitioncited by 16
  2. 2022Speech-based emotion recognition with self-supervised models using attentive channel-wise correlations and label smoothingcited by 10
  3. 2020Recognizing More Emotions with Less Data Using Self-supervised Transfer Learningcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 1.

4 papers.

  1. 2024Exploring WavLM Back-ends for Speech Spoofing and Deepfake Detectioncited by 10
  2. 2025Spoken in Jest, Detected in Earnest: A Systematic Review of Sarcasm Recognition -- Multimodal Fusion, Challenges, and Future Prospectscited by 4
  3. 2025Are Mamba-based Audio Foundation Models the Best Fit for Non-Verbal Emotion Recognition?cited by 0
  4. 2026Spectrogram features for audio and speech analysiscited by 0