mlsanityData to 7 Oct 2026

The Prosody of Emojis

arXiv 2508.00537 ↗First posted 1 Aug 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Prosodic features such as pitch, timing, and intonation are central to spoken communication, conveying emotion, intent, and discourse structure. In text-based settings, where these cues are absent, emojis act as visual surrogates that add affective and pragmatic nuance. This study examines how emojis influence prosodic realisation in speech and how listeners interpret prosodic cues to recover emoji meanings. Unlike previous work, we directly link prosody and emojis by analysing human speech data collected through a controlled elicited production task. Using Bayesian multilevel modelling, we show that speakers systematically adapt their prosody based on emoji cues, and that listeners can recover intended meanings significantly above chance. Furthermore, our results reveal a clear hierarchy in prosodic shifts: greater semantic differences between emojis correspond to increased prosodic divergence. These findings suggest that emojis are meaningful carriers of prosodic intent that bridge the gap between digital text and spoken production.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 61 references that are in the map. First posted on arXiv 1 Aug 2025.

Builds on

13 of 61 references.

References · 13

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  3. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 973
  4. 2023Seamless: Multilingual Expressive and Streaming Speech Translationcited by 190
  5. 2018Towards End-to-End Prosody Transfer for Expressive Speech Synthesis with Tacotroncited by 171
  6. 2023CommonAccent: Exploring Large Acoustic Pretrained Models for Accent Classification Based on Common Voicecited by 19
  7. 2023Cross-domain Neural Pitch and Periodicity Estimationcited by 16
  8. 2024Speech is More Than Words: Do Speech-to-Text Translation Systems Leverage Prosody?cited by 13
  9. 2023Quantifying the redundancy between prosody and textcited by 12
  10. 2025The Role of Prosody in Spoken Question Answeringcited by 6
  11. 2024Prosody in Cascade and Direct Speech-to-Text Translation: a case study on Korean Wh-Phrasescited by 5
  12. 2022On the Context-Free Ambiguity of Emojicited by 4
1 more
  1. 2025EmojiVoice: Towards long-term controllable expressivity in robot speechcited by 1

Built on by

Not cited yet.