Spectrogram-Based Detection of Auto-Tuned Vocals in Music Recordings
Not on the map. Why?
Abstract (arXiv)
In the domain of music production and audio processing, the implementation of automatic pitch correction of the singing voice, also known as Auto-Tune, has significantly transformed the landscape of vocal performance. While auto-tuning technology has offered musicians the ability to tune their vocal pitches and achieve a desired level of precision, its use has also sparked debates regarding its impact on authenticity and artistic integrity. As a result, detecting and analyzing Auto-Tuned vocals in music recordings has become essential for music scholars, producers, and listeners. However, to the best of our knowledge, no prior effort has been made in this direction. This study introduces a data-driven approach leveraging triplet networks for the detection of Auto-Tuned songs, backed by the creation of a dataset composed of original and Auto-Tuned audio clips. The experimental results demonstrate the superiority of the proposed method in both accuracy and robustness compared to Rawnet2, an end-to-end model proposed for anti-spoofing and widely used for other audio forensic tasks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 35 references that are in the map. First posted on arXiv 8 Mar 2024.
Builds on
11 of 35 references.
References · 11
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
- 2014Deep metric learning using Triplet networkcited by 422
- 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 180
- 2020End-to-end anti-spoofing with RawNet2cited by 164
- 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 121
- 2023SingFake: Singing Voice Deepfake Detectioncited by 21
- 2023FSD: An Initial Chinese Dataset for Fake Song Detectioncited by 12
- 2020Guitar Effects Recognition and Parameter Estimation with Convolutional Neural Networkscited by 4
Built on by
Not cited yet.