mlsanityData to 14 Oct 2026

ProSarc: Prosody-Aware Sarcasm Recognition Framework via Temporal Prosodic Incongruity

arXiv 2606.06168 ↗First posted 4 Jun 2026cs.AI cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

We present ProSarc, an audio-only framework that detects sarcasm by modelling temporal prosodic incongruity, that is, the mismatch between local prosodic dynamics and the utterance-level emotional baseline. Dual encoding paths, a Global Emotion Encoder and a Temporal Prosody Encoder (BiLSTM + multi-head attention), feed a Prosodic Incongruity Analyzer that produces a scalar incongruity score for classification. Monte Carlo dropout provides uncertainty estimates, and an attention-based mechanism localises sarcastic onset without frame-level labels. ProSarc outperforms prior audio-only methods on MUStARD++ (F1=75.3) and generalises to spontaneous (PodSarc, F1=62.9) and cross-lingual speech (MuSaG, F1=65.6). Ten-run validation confirms the contribution of incongruity modelling (Wilcoxon p=0.002, Cohen's d=1.51). Human evaluation shows that model uncertainty tracks perceptual ambiguity and predicted onsets align with human-annotated temporal windows.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 33 references that are in the map. First posted on arXiv 4 Jun 2026.

Builds on

17 of 33 references.

References · 17

  1. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  2. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  4. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  5. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  6. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
  7. 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 645
  8. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 643
  9. 2019Towards Multimodal Sarcasm Detection (An _Obviously_ Perfect Paper)cited by 174
  10. 2021Emotion Recognition from Speech Using Wav2vec 2.0 Embeddingscited by 162
  11. 2017A Large Self-Annotated Corpus for Sarcasmcited by 64
  12. 2022A Multimodal Corpus for Emotion Recognition in Sarcasmcited by 29
5 more
  1. 2023Sarcasm in Sight and Sound: Benchmarking and Expansion to Improve Multimodal Sarcasm Detectioncited by 7
  2. 2024A Functional Trade-off between Prosodic and Semantic Cues in Conveying Sarcasmcited by 5
  3. 2024AMuSeD: An Attentive Deep Neural Network for Multimodal Sarcasm Detection Incorporating Bi-modal Data Augmentationcited by 5
  4. 2025Spoken in Jest, Detected in Earnest: A Systematic Review of Sarcasm Recognition -- Multimodal Fusion, Challenges, and Future Prospectscited by 4
  5. 2025MuSaG: A Multimodal German Sarcasm Dataset with Full-Modal Annotationscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.