mlsanityData to 14 Oct 2026

Synth-JEPA: Joint Embedding Prediction for Renderer-Free Synthesizer Parameter Search

arXiv 2609.31024 ↗First posted 25 Sep 2026cs.SD cs.LG eess.AScited by 0

Not on the map. Why?

Abstract (arXiv)

Sound matching can be formulated as optimizing synthesizer parameters against an audio-domain objective. However, objectives derived from generic audio representations are often difficult to optimize, while direct search requires rendering every candidate. We introduce Synth-JEPA, which learns mutually predictive audio and parameter representations from paired synthesizer data. At inference, candidate parameters are scored directly in this learned space, yielding a renderer-free objective whose audio geometry is shaped by parameter correspondences rather than generic audio similarity. We evaluate Synth-JEPA on Surge XT using held-out synthesizer sounds and out-of-domain NSynth and FSD50K targets, against inverse models, direct search, and learned proxy objectives. Synth-JEPA outperforms all baselines in-domain and remains competitive out-of-domain. Its matching quality continues to improve with additional test-time search, allowing compute to be traded for match quality. In pairwise listening tests, listeners preferred Synth-JEPA in 85% of trials overall. Together, these results show that an audio representation with a parameter-induced geometry allows synthesizer sound matching to be approached as an effective renderer-free search problem.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 23 references that are in the map. First posted on arXiv 25 Sep 2026.

Builds on

10 of 23 references.

References · 10

  1. 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
  2. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
  3. 2020FSD50K: An Open Dataset of Human-Labeled Sound Eventscited by 342
  4. 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 254
  5. 2017Neural Audio Synthesis of Musical Notes with WaveNet Autoencoderscited by 225
  6. 2022Efficient Large-scale Audio Tagging via Transformer-to-CNN Knowledge Distillationcited by 27
  7. 2025Audio synthesizer inversion in symmetric parameter spaces with approximately equivariant flow matchingcited by 6
  8. 2025SLAP: Siamese Language-Audio Pretraining Without Negative Samples for Music Understandingcited by 4
  9. 2026LeVLJEPA: End-to-End Vision-Language Pretraining Without Negativescited by 2
  10. 2026FM Synthesizer Audio-Parameter Shared Embeddingscited by 1

Built on by

Not cited yet.