BREATH: A Bio-Radar Embodied Agent for Tonal and Human-Aware Diffusion Music Generation
Not on the map. Why?
Abstract (arXiv)
We present a multimodal system for personalized music generation that integrates physiological sensing, LLM-based reasoning, and controllable audio synthesis. A millimeter-wave radar sensor non-invasively captures heart rate and respiration rate. These physiological signals, combined with environmental state, are interpreted by a reasoning agent to infer symbolic musical descriptors, such as tempo, mood intensity, and traditional Chinese pentatonic modes, which are then expressed as structured prompts to guide a diffusion-based audio model in synthesizing expressive melodies. The system emphasizes cultural grounding through tonal embeddings and enables adaptive, embodied music interaction. To evaluate the system, we adopt a research-creation methodology combining case studies, expert feedback, and targeted control experiments. Results show that physiological variations can modulate musical features in meaningful ways, and tonal conditioning enhances alignment with intended modal characteristics. Expert users reported that the system affords intuitive, culturally resonant musical responses and highlighted its potential for therapeutic and interactive applications. This work demonstrates a novel bio-musical feedback loop linking radar-based sensing, prompt reasoning, and generative audio modeling.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 32 references that are in the map. First posted on arXiv 9 Sep 2025.
Builds on
20 of 32 references.
References · 20
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
- 2023Simple and Controllable Music Generationcited by 480
- 2023MusicLM: Generating Music From Textcited by 442
- 2023High-Fidelity Audio Compression with Improved RVQGANcited by 423
- 2024Stable Audio Opencited by 192
- 2017MuseGAN: Multi-track Sequential Generative Adversarial Networks for Symbolic Music Generation and Accompanimentcited by 151
- 2023MusicLDM: Enhancing Novelty in Text-to-Music Generation Using Beat-Synchronous Mixup Strategiescited by 94
- 2023Efficient Neural Music Generationcited by 50
- 2025DiffRhythm: Blazingly Fast and Embarrassingly Simple End-to-End Full-Length Song Generation with Latent Diffusioncited by 46
8 more
- 2020SongMASS: Automatic Song Writing with Pre-training and Alignment Constraintcited by 41
- 2024ComposerX: Multi-Agent Symbolic Music Composition with LLMscited by 40
- 2025AudioX: A Unified Framework for Anything-to-Audio Generationcited by 25
- 2023MusicAgent: An AI Agent for Music Understanding and Generation with Large Language Modelscited by 20
- 2023Pi-ViMo: Physiology-inspired Robust Vital Sign Monitoring using mmWave Radarscited by 6
- 2024ByteComposer: a Human-like Melody Composition Method based on Language Model Agentcited by 6
- 2020Assisted music creation with Flow Machines: towards new categories of newcited by 3
- 2024Noncontact Multi-Point Vital Sign Monitoring with mmWave MIMO Radarcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Pitch-class Steering for Diffusion-based Music Generation via Latent-space Probes
- 2026Democratizing Music Therapy: LLM-Based Automated EEG Analysis and Progress Tracking for Low-Cost Home Devices ↗
- 2024Naturalistic Music Decoding from EEG Data via Latent Diffusion Models
- 2026MindMelody: A Closed-Loop EEG-Driven System for Personalized Music Intervention
- 2026TADA! Tuning Audio Diffusion Models through Activation Steering
- 2025Generation of Musical Timbres using a Text-Guided Diffusion Model
- 2024Editing Music with Melody and Text: Using ControlNet for Diffusion Transformer
- 2026DiffSynth-Music: Audio-Conditioned KV-Cache Adapters for Controllable Music Generation