ProSarc: Prosody-Aware Sarcasm Recognition Framework via Temporal Prosodic Incongruity
Not on the map. Why?
Abstract (arXiv)
We present ProSarc, an audio-only framework that detects sarcasm by modelling temporal prosodic incongruity, that is, the mismatch between local prosodic dynamics and the utterance-level emotional baseline. Dual encoding paths, a Global Emotion Encoder and a Temporal Prosody Encoder (BiLSTM + multi-head attention), feed a Prosodic Incongruity Analyzer that produces a scalar incongruity score for classification. Monte Carlo dropout provides uncertainty estimates, and an attention-based mechanism localises sarcastic onset without frame-level labels. ProSarc outperforms prior audio-only methods on MUStARD++ (F1=75.3) and generalises to spontaneous (PodSarc, F1=62.9) and cross-lingual speech (MuSaG, F1=65.6). Ten-run validation confirms the contribution of incongruity modelling (Wilcoxon p=0.002, Cohen's d=1.51). Human evaluation shows that model uncertainty tracks perceptual ambiguity and predicted onsets align with human-annotated temporal windows.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 33 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
17 of 33 references.
References · 17
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 645
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 643
- 2019Towards Multimodal Sarcasm Detection (An _Obviously_ Perfect Paper)cited by 174
- 2021Emotion Recognition from Speech Using Wav2vec 2.0 Embeddingscited by 162
- 2017A Large Self-Annotated Corpus for Sarcasmcited by 64
- 2022A Multimodal Corpus for Emotion Recognition in Sarcasmcited by 29
5 more
- 2023Sarcasm in Sight and Sound: Benchmarking and Expansion to Improve Multimodal Sarcasm Detectioncited by 7
- 2024A Functional Trade-off between Prosodic and Semantic Cues in Conveying Sarcasmcited by 5
- 2024AMuSeD: An Attentive Deep Neural Network for Multimodal Sarcasm Detection Incorporating Bi-modal Data Augmentationcited by 5
- 2025Spoken in Jest, Detected in Earnest: A Systematic Review of Sarcasm Recognition -- Multimodal Fusion, Challenges, and Future Prospectscited by 4
- 2025MuSaG: A Multimodal German Sarcasm Dataset with Full-Modal Annotationscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.