Smorph: Playable Sound Morphing with Diffusion Models
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
Sound morphing, generating intermediate sounds that transition from one sonic identity to another, can be a powerful tool for musical sound design. Existing diffusion-based morphing approaches entangle temporal structure and timbral identity, offering no mechanism to hold one fixed while transforming the other. We present smorph, a training-free guidance framework that preserves how a sound behaves over time while transforming what the sound is, allowing users to morph, for instance from brass to strings at a fixed pitch. We demonstrate across three morphing modes: prompt-to-prompt, audio-to-prompt, and audio-to-audio. Evaluations across diverse datasets show that smorph effectively produces smooth morph trajectories while substantially improving temporal-structure and source preservation over baselines, albeit with more conservative target-ward transformation in some settings. In an exploratory case study, musicians found smorph trajectories to be expressive and playable, suggesting structural anchoring can serve as a productive constraint for instrumental interaction.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. First posted on arXiv 5 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Mix2Morph: Learning Sound Morphing from Noisy Mixes
- 2024SoundMorpher: Perceptually-Uniform Sound Morphing with Diffusion Model
- 2024MorphFader: Enabling Fine-grained Controllable Morphing with Text-to-Audio Models
- 2026Diffusion Timbre Transfer Via Mutual Information Guided Inpainting
- 2025AudioMorphix: Training-free audio editing with diffusion probabilistic models
- 2024Improving Musical Accompaniment Co-creation via Diffusion Transformers
- 2025Diff-TONE: Timestep Optimization for iNstrument Editing in Text-to-Music Diffusion Models
- 2024DisMix: Disentangling Mixtures of Musical Instruments for Source-level Pitch and Timbre Manipulation