CNN+LSTM Architecture for Speech Emotion Recognition with Data Augmentation
Not on the map. Why?
Abstract (arXiv)
In this work we design a neural network for recognizing emotions in speech, using the IEMOCAP dataset. Following the latest advances in audio analysis, we use an architecture involving both convolutional layers, for extracting high-level features from raw spectrograms, and recurrent ones for aggregating long-term dependencies. We examine the techniques of data augmentation with vocal track length perturbation, layer-wise optimizer adjustment, batch normalization of recurrent layers and obtain highly competitive results of 64.5% for weighted accuracy and 61.7% for unweighted accuracy on four emotions.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 4; 2023: 2; 2024: 1; 2025: 3; 2026: 3.
17 papers.
Sort:
- 2021Exploring Wav2vec 2.0 fine-tuning for improved speech emotion recognitioncited by 47
- 2021Improved Speech Emotion Recognition using Transfer Learning and Spectrogram Augmentationcited by 12
- 2022Multimodal Emotion Recognition using Transfer Learning from Speaker Recognition and BERT-based modelscited by 7
- 2022Emotion Recognition In Persian Speech Using Deep Neural Networkscited by 7
- 2022Improving Speech Emotion Recognition with Unsupervised Speaking Style Transfercited by 3
- 2023Learning Multilingual Expressive Speech Representation for Prosody Prediction without Parallel Datacited by 3
- 2024MSP-Podcast SER Challenge 2024: L'antenne du Ventoux Multimodal Self-Supervised Learning for Speech Emotion Recognitioncited by 3
- 2025Enhancing Generalization in PPG-Based Emotion Measurement with a CNN-TCN-LSTM Modelcited by 3
- 2021A novel policy for pre-trained Deep Reinforcement Learning for Speech Emotion Recognitioncited by 2
- 2022Multilingual Speech Emotion Recognition With Multi-Gating Mechanism and Neural Architecture Searchcited by 1
- 2023Enhancing Speech Emotion Recognition Through Differentiable Architecture Searchcited by 1
- 2021Speech Emotion Recognition Using Deep Sparse Auto-Encoder Extreme Learning Machine with a New Weighting Scheme and Spectro-Temporal Features Along with Classical Feature Selection and A New Quantum-Inspired Dimension Reduction Methodcited by 0
5 more
- 2025Representation Learning with Parameterised Quantum Circuits for Advancing Speech Emotion Recognitioncited by 0
- 2025EmoAugNet: A Signal-Augmented Hybrid CNN-LSTM Framework for Speech Emotion Recognitioncited by 0
- 2026Speech Emotion Recognition Using MFCC Features and LSTM-Based Deep Learning Modelcited by 0
- 2026Low-resource Language Discrimination Towards Chinese Dialects with Transfer learning and Data Augmentationcited by 0
- 2026Explainable Lightweight Compact Deep Models for Speech Emotion Recognitioncited by 0
- 2026Explainable Lightweight Compact Deep Models for Speech Emotion Recognition18 Jul 2026
- 2026Low-resource Language Discrimination Towards Chinese Dialects with Transfer learning and Data Augmentation17 Jun 2026
- 2026Speech Emotion Recognition Using MFCC Features and LSTM-Based Deep Learning Model16 Apr 2026
- 2025EmoAugNet: A Signal-Augmented Hybrid CNN-LSTM Framework for Speech Emotion Recognition6 Aug 2025
- 2025Enhancing Generalization in PPG-Based Emotion Measurement with a CNN-TCN-LSTM Model10 Jul 2025
- 2025Representation Learning with Parameterised Quantum Circuits for Advancing Speech Emotion Recognition21 Jan 2025
- 2024MSP-Podcast SER Challenge 2024: L'antenne du Ventoux Multimodal Self-Supervised Learning for Speech Emotion Recognition8 Jul 2024
- 2023Learning Multilingual Expressive Speech Representation for Prosody Prediction without Parallel Data29 Jun 2023
- 2023Enhancing Speech Emotion Recognition Through Differentiable Architecture Search23 May 2023
- 2022Improving Speech Emotion Recognition with Unsupervised Speaking Style Transfer16 Nov 2022
- 2022Multilingual Speech Emotion Recognition With Multi-Gating Mechanism and Neural Architecture Search31 Oct 2022
- 2022Emotion Recognition In Persian Speech Using Deep Neural Networks28 Apr 2022
5 more
- 2022Multimodal Emotion Recognition using Transfer Learning from Speaker Recognition and BERT-based models16 Feb 2022
- 2021Speech Emotion Recognition Using Deep Sparse Auto-Encoder Extreme Learning Machine with a New Weighting Scheme and Spectro-Temporal Features Along with Classical Feature Selection and A New Quantum-Inspired Dimension Reduction Method13 Nov 2021
- 2021Exploring Wav2vec 2.0 fine-tuning for improved speech emotion recognition12 Oct 2021
- 2021Improved Speech Emotion Recognition using Transfer Learning and Spectrogram Augmentation5 Aug 2021
- 2021A novel policy for pre-trained Deep Reinforcement Learning for Speech Emotion Recognition4 Jan 2021
- 2021Exploring Wav2vec 2.0 fine-tuning for improved speech emotion recognitioncited by 47
- 2021Improved Speech Emotion Recognition using Transfer Learning and Spectrogram Augmentationcited by 12
- 2022Multimodal Emotion Recognition using Transfer Learning from Speaker Recognition and BERT-based modelscited by 7
- 2022Emotion Recognition In Persian Speech Using Deep Neural Networkscited by 7
- 2022Improving Speech Emotion Recognition with Unsupervised Speaking Style Transfercited by 3
- 2023Learning Multilingual Expressive Speech Representation for Prosody Prediction without Parallel Datacited by 3
- 2024MSP-Podcast SER Challenge 2024: L'antenne du Ventoux Multimodal Self-Supervised Learning for Speech Emotion Recognitioncited by 3
- 2025Enhancing Generalization in PPG-Based Emotion Measurement with a CNN-TCN-LSTM Modelcited by 3
- 2021A novel policy for pre-trained Deep Reinforcement Learning for Speech Emotion Recognitioncited by 2
- 2022Multilingual Speech Emotion Recognition With Multi-Gating Mechanism and Neural Architecture Searchcited by 1
- 2023Enhancing Speech Emotion Recognition Through Differentiable Architecture Searchcited by 1
- 2021Speech Emotion Recognition Using Deep Sparse Auto-Encoder Extreme Learning Machine with a New Weighting Scheme and Spectro-Temporal Features Along with Classical Feature Selection and A New Quantum-Inspired Dimension Reduction Methodcited by 0
12 most cited of 17 All 17 (JSON)
- 2026Explainable Lightweight Compact Deep Models for Speech Emotion Recognition18 Jul 2026
- 2026Low-resource Language Discrimination Towards Chinese Dialects with Transfer learning and Data Augmentation17 Jun 2026
- 2026Speech Emotion Recognition Using MFCC Features and LSTM-Based Deep Learning Model16 Apr 2026
- 2025EmoAugNet: A Signal-Augmented Hybrid CNN-LSTM Framework for Speech Emotion Recognition6 Aug 2025
- 2025Enhancing Generalization in PPG-Based Emotion Measurement with a CNN-TCN-LSTM Model10 Jul 2025
- 2025Representation Learning with Parameterised Quantum Circuits for Advancing Speech Emotion Recognition21 Jan 2025
- 2024MSP-Podcast SER Challenge 2024: L'antenne du Ventoux Multimodal Self-Supervised Learning for Speech Emotion Recognition8 Jul 2024
- 2023Learning Multilingual Expressive Speech Representation for Prosody Prediction without Parallel Data29 Jun 2023
- 2023Enhancing Speech Emotion Recognition Through Differentiable Architecture Search23 May 2023
- 2022Improving Speech Emotion Recognition with Unsupervised Speaking Style Transfer16 Nov 2022
- 2022Multilingual Speech Emotion Recognition With Multi-Gating Mechanism and Neural Architecture Search31 Oct 2022
- 2022Emotion Recognition In Persian Speech Using Deep Neural Networks28 Apr 2022
12 newest of 17 All 17 (JSON)