Beyond Discrete Categories: Multi-Task Valence-Arousal Modeling for Pet Vocalization Analysis
Not on the map. Why?
Abstract (arXiv)
Traditional pet emotion recognition from vocalizations, based on discrete classification, struggles with ambiguity and capturing intensity variations. We propose a continuous Valence-Arousal (VA) model that represents emotions in a two-dimensional space. Our method uses an automatic VA label generation algorithm, enabling large-scale annotation of 42,553 pet vocalization samples. A multi-task learning framework jointly trains VA regression with auxiliary tasks (emotion, body size, gender) to enhance prediction by improving feature learning. Our Audio Transformer model achieves a validation Valence Pearson correlation of r = 0.9024 and an Arousal r = 0.7155, effectively resolving confusion between discrete categories like "territorial" and "happy." This work introduces the first continuous VA framework for pet vocalization analysis, offering a more expressive representation for human-pet interaction, veterinary diagnostics, and behavioral training. The approach shows strong potential for deployment in consumer products like AI pet emotion translators.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 29 references that are in the map. First posted on arXiv 9 Oct 2025.
Builds on
7 of 29 references.
References · 7
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 803
- 2021AST: Audio Spectrogram Transformercited by 643
- 2018Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyondcited by 216
- 2021SSAST: Self-Supervised Audio Spectrogram Transformercited by 169
- 2019AVEC 2019 Workshop and Challenge: State-of-Mind, Detecting Depression with AI, and Cross-Cultural Affect Recognitioncited by 87
- 2024Towards Dog Bark Decoding: Leveraging Human Speech Processing for Automated Bark Classificationcited by 6
Built on by
Not cited yet.