mlsanityData to 13 Oct 2026

Breaking Resource Barriers in Speech Emotion Recognition via Data Distillation

arXiv 2406.15119 ↗First posted 21 Jun 2024cs.SD cs.AI eess.AScited by 1

Not on the map. Why?

Abstract (arXiv)

Speech emotion recognition (SER) plays a crucial role in human-computer interaction. The emergence of edge devices in the Internet of Things (IoT) presents challenges in constructing intricate deep learning models due to constraints in memory and computational resources. Moreover, emotional speech data often contains private information, raising concerns about privacy leakage during the deployment of SER models. To address these challenges, we propose a data distillation framework to facilitate efficient development of SER models in IoT applications using a synthesised, smaller, and distilled dataset. Our experiments demonstrate that the distilled dataset can be effectively utilised to train SER models with fixed initialisation, achieving performances comparable to those developed using the original full emotional speech dataset.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 19 of its 41 references that are in the map. First posted on arXiv 21 Jun 2024.

Builds on

19 of 41 references.

References · 19

  1. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,870
  2. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,313
  3. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,017
  4. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,625
  5. 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 814
  6. 2022Dataset Distillation by Matching Training Trajectoriescited by 438
  7. 2018Dataset Distillationcited by 226
  8. 2021Dataset Distillation with Infinitely Wide Convolutional Networkscited by 216
  9. 2022Privacy for Free: How does Dataset Condensation Help Privacy?cited by 119
  10. 2019Soft-Label Dataset Distillation and Text Dataset Distillationcited by 106
  11. 2023Data Distillation: A Surveycited by 86
  12. 2018A Survey of Machine and Deep Learning Methods for Internet of Things (IoT) Securitycited by 42
7 more
  1. 2020Towards Data Distillation for End-to-end Spoken Conversational Question Answeringcited by 35
  2. 2022FedSynth: Gradient Compression via Synthetic Data in Federated Learningcited by 30
  3. 2022Meta Knowledge Condensation for Federated Learningcited by 26
  4. 2020Deep Learning in Industrial Internet of Things: Potentials, Challenges, and Emerging Applicationscited by 19
  5. 2022Fast Yet Effective Speech Emotion Recognition with Self-distillationcited by 7
  6. 2022Knowledge Transfer For On-Device Speech Emotion Recognition with Neural Structured Learningcited by 4
  7. 2024STAA-Net: A Sparse and Transferable Adversarial Attack for Speech Emotion Recognitioncited by 1

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 1.

1 paper.