Burst2Vec: An Adversarial Multi-Task Approach for Predicting Emotion, Age, and Origin from Vocal Bursts
Not on the map. Why?
Abstract (arXiv)
We present Burst2Vec, our multi-task learning approach to predict emotion, age, and origin (i.e., native country/language) from vocal bursts. Burst2Vec utilises pre-trained speech representations to capture acoustic information from raw waveforms and incorporates the concept of model debiasing via adversarial training. Our models achieve a relative 30 % performance gain over baselines using pre-extracted features and score the highest amongst all participants in the ICML ExVo 2022 Multi-Task Challenge.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 10 of its 21 references that are in the map. First posted on arXiv 24 Jun 2022.
Builds on
10 of 21 references.
References · 10
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 791
- 2021Emotion Recognition from Speech Using Wav2vec 2.0 Embeddingscited by 158
- 2021The INTERSPEECH 2021 Computational Paralinguistics Challenge: COVID-19 Cough, COVID-19 Speech, Escalation & Primatescited by 32
- 2020On the use of Self-supervised Pre-trained Acoustic and Linguistic Features for Continuous Speech Emotion Recognitioncited by 19
- 2022The ICML 2022 Expressive Vocalizations Workshop and Competition: Recognizing, Generating, and Personalizing Vocal Burstscited by 16
Built on by
Citing papers per year: 2022: 1; 2023: 2.
3 papers.
- 2022An Efficient Multitask Learning Architecture for Affective Vocal Burst Analysiscited by 1
- 2023EmoGator: A New Open Source Vocal Burst Dataset with Baseline Machine Learning Classification Methodologiescited by 1
- 2023A Hierarchical Regression Chain Framework for Affective Vocal Burst Recognitioncited by 1
- 2023A Hierarchical Regression Chain Framework for Affective Vocal Burst Recognition14 Mar 2023
- 2023EmoGator: A New Open Source Vocal Burst Dataset with Baseline Machine Learning Classification Methodologies2 Jan 2023
- 2022An Efficient Multitask Learning Architecture for Affective Vocal Burst Analysis28 Sep 2022