Echoes of Humanity: Exploring the Perceived Humanness of AI Music
Not on the map. Why?
Abstract (arXiv)
Recent advances in AI music (AIM) generation services are currently transforming the music industry. Given these advances, understanding how humans perceive AIM is crucial both to educate users on identifying AIM songs, and, conversely, to improve current models. We present results from a listener-focused experiment aimed at understanding how humans perceive AIM. In a blind, Turing-like test, participants were asked to distinguish, from a pair, the AIM and human-made song. We contrast with other studies by utilizing a randomized controlled crossover trial that controls for pairwise similarity and allows for a causal interpretation. We are also the first study to employ a novel, author-uncontrolled dataset of AIM songs from real-world usage of commercial models (i.e., Suno). We establish that listeners' reliability in distinguishing AIM causally increases when pairs are similar. Lastly, we conduct a mixed-methods content analysis of listeners' free-form feedback, revealing a focus on vocal and technical cues in their judgments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 39 references that are in the map. First posted on arXiv 29 Sep 2025.
Builds on
16 of 39 references.
References · 16
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
- 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
- 2023Simple and Controllable Music Generationcited by 488
- 2017CAN: Creative Adversarial Networks, Generating "Art" by Learning About Styles and Deviating from Style Normscited by 96
- 2023Art and the science of generative AI: A deeper divecited by 95
- 2021Understanding and Creating Art with AI: Review and Outlookcited by 60
- 2019LakhNES: Improving multi-instrumental music generation with cross-domain pre-trainingcited by 54
- 2025Benchmarking Music Generation Models and Metrics via Human Preference Studiescited by 15
- 2024Natural Language Processing Methods for Symbolic Music Generation and Information Retrieval: a Surveycited by 10
- 2025Survey on the Evaluation of Generative Models in Musiccited by 10
- 2020TensorFlow Audio Models in Essentiacited by 9
4 more
- 2022Subjective Evaluation of Deep Learning Models for Symbolic Music Compositioncited by 5
- 2025When Incentives Backfire, Data Stops Being Humancited by 4
- 2024Between the AI and Me: Analysing Listeners' Perspectives on AI- and Human-Composed Progressive Metal Musiccited by 3
- 2025Understanding Listener Perceptions of AI and Human-Composed Music in Emotional Applicationscited by 1
Built on by
Not cited yet.