mlsanityData to 7 Oct 2026

FlowSynth: Instrument Generation Through Distributional Flow Matching and Test-Time Search

arXiv 2510.21667 ↗First posted 24 Oct 2025cs.SDcited by 2

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Virtual instrument generation requires maintaining consistent timbre across different pitches and velocities, a challenge that existing note-level models struggle to address. We present FlowSynth, which combines distributional flow matching (DFM) with test-time optimization for high-quality instrument synthesis. Unlike standard flow matching that learns deterministic mappings, DFM parameterizes the velocity field as a Gaussian distribution and optimizes via negative log-likelihood, enabling the model to express uncertainty in its predictions. This probabilistic formulation allows principled test-time search: we sample multiple trajectories weighted by model confidence and select outputs that maximize timbre consistency. FlowSynth outperforms the current state-of-the-art TokenSynth baseline in both single-note quality and cross-note consistency. Our approach demonstrates that modeling predictive uncertainty in flow matching, combined with music-specific consistency objectives, provides an effective path to professional-quality virtual instruments suitable for real-time performance.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 13 of its 18 references that are in the map. First posted on arXiv 24 Oct 2025.

Builds on

13 of 18 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025DiffRhythm: Blazingly Fast and Embarrassingly Simple End-to-End Full-Length Song Generation with Latent Diffusion3 Mar

Other references · 12

  1. 2022Scalable Diffusion Models with Transformerscited by 5,931
  2. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
  3. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 707
  4. 2017Neural Audio Synthesis of Musical Notes with WaveNet Autoencoderscited by 222
  5. 2018Fr'echet Audio Distance: A Metric for Evaluating Music Enhancement Algorithmscited by 221
  6. 2024BoNBoN Alignment for Large Language Models and the Sweetness of Best-of-n Samplingcited by 120
  7. 2025Variational Rectified Flow Matchingcited by 34
  8. 2019Learning Disentangled Representations of Timbre and Pitch for Musical Instrument Sounds Using Gaussian Mixture Variational Autoencoderscited by 21
  9. 2024MusicFlow: Cascaded Flow Matching for Text Guided Music Generationcited by 14
  10. 2024Iterated Energy-based Flow Matching for Sampling from Boltzmann Densitiescited by 12
  11. 2025TokenSynth: A Token-based Neural Synthesizer for Instrument Cloning and Text-to-Instrumentcited by 5
  12. 2023InstrumentGen: Generating Sample-Based Musical Instruments From Textcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Auto-Regressive vs Flow-Matching: a Comparative Study of Modeling Paradigms for Text-to-Music Generation
  2. 2025GuitarFlow: Realistic Electric Guitar Synthesis From Tablatures via Flow Matching and Style Transfer
  3. 2026Synthesis and editing of multi-instrument audio mixtures using scalar-quantised latents with MIDI Span conditioning
  4. 2025Diff-TONE: Timestep Optimization for iNstrument Editing in Text-to-Music Diffusion Models
  5. 2024WaveTransfer: A Flexible End-to-end Multi-instrument Timbre Transfer with Diffusion
  6. 2022Multi-instrument Music Synthesis with Spectrogram Diffusion
  7. 2026PianoKontext: Expressive Performance Rendering from Deadpan Context
  8. 2026PianoFlow: Music-Aware Streaming Piano Motion Generation with Bimanual Coordination