mlsanityData to 7 Oct 2026

Smorph: Playable Sound Morphing with Diffusion Models

arXiv 2610.06478 ↗First posted 5 Oct 2026cs.SD eess.AScited by 0

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Sound morphing, generating intermediate sounds that transition from one sonic identity to another, can be a powerful tool for musical sound design. Existing diffusion-based morphing approaches entangle temporal structure and timbral identity, offering no mechanism to hold one fixed while transforming the other. We present smorph, a training-free guidance framework that preserves how a sound behaves over time while transforming what the sound is, allowing users to morph, for instance from brass to strings at a fixed pitch. We demonstrate across three morphing modes: prompt-to-prompt, audio-to-prompt, and audio-to-audio. Evaluations across diverse datasets show that smorph effectively produces smooth morph trajectories while substantially improving temporal-structure and source preservation over baselines, albeit with more conservative target-ward transformation in some settings. In an exploratory case study, musicians found smorph trajectories to be expressive and playable, suggesting structural anchoring can serve as a productive constraint for instrumental interaction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. First posted on arXiv 5 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Mix2Morph: Learning Sound Morphing from Noisy Mixes
  2. 2024SoundMorpher: Perceptually-Uniform Sound Morphing with Diffusion Model
  3. 2024MorphFader: Enabling Fine-grained Controllable Morphing with Text-to-Audio Models
  4. 2026Diffusion Timbre Transfer Via Mutual Information Guided Inpainting
  5. 2025AudioMorphix: Training-free audio editing with diffusion probabilistic models
  6. 2024Improving Musical Accompaniment Co-creation via Diffusion Transformers
  7. 2025Diff-TONE: Timestep Optimization for iNstrument Editing in Text-to-Music Diffusion Models
  8. 2024DisMix: Disentangling Mixtures of Musical Instruments for Source-level Pitch and Timbre Manipulation