mlsanityData to 14 Oct 2026

Revisiting Input Time-frequency Representations in Multi-pitch Estimation for Vocal Ensembles

arXiv 2610.03656 ↗First posted 2 Oct 2026cs.SD cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-pitch estimation in vocal ensembles is challenging because singers occupy overlapping pitch ranges and often sing at closely spaced fundamental frequencies, causing their harmonics to overlap in time-frequency representations. Existing models commonly use harmonic constant-Q transform (HCQT)-based representations to provide frequency-adaptive resolution, at the cost of expensive feature extraction when training mixtures are generated on the fly. We revisit this design and compare HCQT with a linear short-time Fourier transform (STFT), whose frequency bins are directly provided as model inputs. Despite its fixed frequency resolution and the absence of a pitch-aligned input grid, the linear STFT outperforms HCQT while substantially reducing feature-extraction cost. Further analysis shows that a longer analysis window or broader spectral coverage provides no additional improvement, while restricting the input to the predicted pitch range reduces the advantage of the linear STFT. These results suggest that finer frequency resolution does not necessarily improve vocal-ensemble MPE, and that shorter analysis windows can be more effective for time-varying vocal pitches.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 30 references that are in the map. First posted on arXiv 2 Oct 2026.

Builds on

14 of 30 references.

References · 14

  1. 2022A ConvNet for the 2020scited by 3,579
  2. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  3. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
  4. 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
  5. 2018CREPE: A Convolutional Representation for Pitch Estimationcited by 110
  6. 2017Onsets and Frames: Dual-Objective Piano Transcriptioncited by 94
  7. 2023InceptionNeXt: When Inception Meets ConvNeXtcited by 86
  8. 2023RMVPE: A Robust Model for Vocal Pitch Estimation in Polyphonic Musiccited by 30
  9. 2022A Lightweight Instrument-Agnostic Model for Polyphonic Note Transcription and Multipitch Estimationcited by 28
  10. 2019Simultaneous Separation and Transcription of Mixtures with Multiple Polyphonic and Percussive Instrumentscited by 18
  11. 2020Deep Learning Based Source Separation Applied To Choir Ensemblescited by 10
  12. 2020Multiple F0 Estimation in Vocal Ensembles using Convolutional Neural Networkscited by 6
2 more
  1. 2022JaCappella Corpus: A Japanese a Cappella Vocal Ensemble Corpuscited by 5
  2. 2023ChoralSynth: Synthetic Dataset of Choral Singingcited by 1

Built on by

Not cited yet.