mlsanityData to 14 Oct 2026

EmoHeal: An End-to-End System for Personalized Therapeutic Music Retrieval from Fine-grained Emotions

arXiv 2509.15986 ↗First posted 19 Sep 2025cs.LG cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Existing digital mental wellness tools often overlook the nuanced emotional states underlying everyday challenges. For example, pre-sleep anxiety affects more than 1.5 billion people worldwide, yet current approaches remain largely static and "one-size-fits-all", failing to adapt to individual needs. In this work, we present EmoHeal, an end-to-end system that delivers personalized, three-stage supportive narratives. EmoHeal detects 27 fine-grained emotions from user text with a fine-tuned XLM-RoBERTa model, mapping them to musical parameters via a knowledge graph grounded in music therapy principles (GEMS, iso-principle). EmoHeal retrieves audiovisual content using the CLAMP3 model to guide users from their current state toward a calmer one ("match-guide-target"). A within-subjects study (N=40) demonstrated significant supportive effects, with participants reporting substantial mood improvement (M=4.12, p<0.001) and high perceived emotion recognition accuracy (M=4.05, p<0.001). A strong correlation between perceived accuracy and therapeutic outcome (r=0.72, p<0.001) validates our fine-grained approach. These findings establish the viability of theory-driven, emotion-aware digital wellness tools and provides a scalable AI blueprint for operationalizing music therapy principles.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 29 references that are in the map. First posted on arXiv 19 Sep 2025.

Builds on

16 of 29 references.

References · 16

  1. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  2. 2016CNN Architectures for Large-Scale Audio Classificationcited by 704
  3. 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 486
  4. 2023MusicLM: Generating Music From Textcited by 448
  5. 2022MuLan: A Joint Embedding of Music Audio and Natural Languagecited by 87
  6. 2023WavJourney: Compositional Audio Creation with Large Language Modelscited by 27
  7. 2025CLaMP 3: Universal Music Information Retrieval Across Unaligned Modalities and Unseen Languagescited by 21
  8. 2024WavCraft: Audio Editing and Generation with Large Language Modelscited by 14
  9. 2024DExter: Learning and Controlling Performance Expression with Diffusion Modelscited by 11
  10. 2023Leveraging Pre-trained AudioLDM for Sound Generation: A Benchmark Studycited by 10
  11. 2023Adapting Language-Audio Models as Few-Shot Audio Learnerscited by 10
  12. 2023Acoustic Prompt Tuning: Empowering Large Language Models with Audition Capabilitiescited by 10
4 more
  1. 2024Bridging Paintings and Music -- Exploring Emotion based Music Generation through Paintingscited by 6
  2. 2024Bridging Discrete and Continuous: A Multimodal Strategy for Complex Emotion Detectioncited by 6
  3. 2024LLaQo: Towards a Query-Based Coach in Expressive Music Performance Assessmentcited by 5
  4. 2025RenderBox: Expressive Performance Rendering with Text Controlcited by 4

Built on by

Not cited yet.