mlsanityData to 14 Oct 2026

Lightweight Self-Supervised Detection of Fundamental Frequency and Accurate Probability of Voicing in Monophonic Music

arXiv 2601.11768 ↗First posted 16 Jan 2026eess.AS cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Reliable fundamental frequency (F 0) and voicing estimation is essential for neural synthesis, yet many pitch extractors depend on large labeled corpora and degrade under realistic recording artifacts. We propose a lightweight, fully self-supervised framework for joint F 0 estimation and voicing inference, designed for rapid single-instrument training from limited audio. Using transposition-equivariant learning on CQT features, we introduce an EM-style iterative reweighting scheme that uses Shift Cross-Entropy (SCE) consistency as a reliability signal to suppress uninformative noisy/unvoiced frames. The resulting weights provide confidence scores that enable pseudo-labeling for a separate lightweight voicing classifier without manual annotations. Trained on MedleyDB and evaluated on MDB-stem-synth ground truth, our method achieves competitive cross-corpus performance (RPA 95.84, RCA 96.24) and demonstrates cross-instrument generalization.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 22 references that are in the map. First posted on arXiv 16 Jan 2026.

Builds on

9 of 22 references.

References · 9

  1. 2020Shortcut Learning in Deep Neural Networkscited by 1,969
  2. 2020DDSP: Differentiable Digital Signal Processingcited by 178
  3. 2018CREPE: A Convolutional Representation for Pitch Estimationcited by 110
  4. 2019SPICE: Self-supervised Pitch Estimationcited by 27
  5. 2023A Review of Differentiable Digital Signal Processing for Music & Speech Synthesiscited by 20
  6. 2023PESTO: Pitch Estimation with Self-supervised Transposition-equivariant Objectivecited by 18
  7. 2023Cross-domain Neural Pitch and Periodicity Estimationcited by 16
  8. 2021DEEPF0: End-To-End Fundamental Frequency Estimation for Music and Speech Signalscited by 7
  9. 2025PESTO: Real-Time Pitch Estimation with Self-supervised Transposition-equivariant Objectivecited by 3

Built on by

Not cited yet.