mlsanityData to 7 Oct 2026

ViolinDiff: Enhancing Expressive Violin Synthesis with Pitch Bend Conditioning

arXiv 2409.12477 ↗First posted 19 Sep 2024cs.SD cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Modeling the natural contour of fundamental frequency (F0) plays a critical role in music audio synthesis. However, transcribing and managing multiple F0 contours in polyphonic music is challenging, and explicit F0 contour modeling has not yet been explored for polyphonic instrumental synthesis. In this paper, we present ViolinDiff, a two-stage diffusion-based synthesis framework. For a given violin MIDI file, the first stage estimates the F0 contour as pitch bend information, and the second stage generates mel spectrogram incorporating these expressive details. The quantitative metrics and listening test results show that the proposed model generates more realistic violin sounds than the model without explicit pitch bend modeling. Audio samples are available online: daewoung.github.io/ViolinDiff-Demo.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 32 references that are in the map. First posted on arXiv 19 Sep 2024.

Builds on

23 of 32 references.

References · 23

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2022Classifier-Free Diffusion Guidancecited by 5,717
  4. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  5. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  6. 2021SoundStream: An End-to-End Neural Audio Codeccited by 756
  7. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 707
  8. 2016CNN Architectures for Large-Scale Audio Classificationcited by 701
  9. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
  10. 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 445
  11. 2023Human Motion Diffusion as a Generative Priorcited by 354
  12. 2022EDGE: Editable Dance Generation From Musiccited by 284
11 more
  1. 2020Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Searchcited by 269
  2. 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
  3. 2017Onsets and Frames: Dual-Objective Piano Transcriptioncited by 93
  4. 2023Adapting Frechet Audio Distance for Generative Music Evaluationcited by 92
  5. 2022Multi-instrument Music Synthesis with Spectrogram Diffusioncited by 42
  6. 2021VISinger: Variational Inference with Adversarial Learning for End-to-End Singing Voice Synthesiscited by 38
  7. 2020XiaoiceSing: A High-Quality and Integrated Singing Voice Synthesis Systemcited by 33
  8. 2021MIDI-DDSP: Detailed Control of Musical Performance via Hierarchical Modelingcited by 31
  9. 2022Deep Performer: Score-to-Audio Music Performance Synthesiscited by 12
  10. 2023Performance Conditioning for Diffusion-Based Multi-Instrument Music Synthesiscited by 5
  11. 2024Expressive Acoustic Guitar Sound Synthesis with an Instrument-Specific Input Representation and Diffusion Outpaintingcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026VIOLET: High-Fidelity Violin Synthesis with Techniques and Dynamicscited by 0