mlsanityData to 7 Oct 2026

Pop2Piano : Pop Audio-based Piano Cover Generation

arXiv 2211.00895 ↗First posted 2 Nov 2022cs.SD cs.LG eess.AScited by 10

Not on the map. Why?

Abstract (arXiv)

Piano covers of pop music are enjoyed by many people. However, the task of automatically generating piano covers of pop music is still understudied. This is partly due to the lack of synchronized {Pop, Piano Cover} data pairs, which made it challenging to apply the latest data-intensive deep learning-based methods. To leverage the power of the data-driven approach, we make a large amount of paired and synchronized {Pop, Piano Cover} data using an automated pipeline. In this paper, we present Pop2Piano, a Transformer network that generates piano covers given waveforms of pop music. To the best of our knowledge, this is the first model to generate a piano cover directly from pop audio without using melody and chord extraction modules. We show that Pop2Piano, trained with our dataset, is capable of producing plausible piano covers.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 12 of its 30 references that are in the map. First posted on arXiv 2 Nov 2022.

Builds on

12 of 30 references.

References · 12

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 896
  3. 2018Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Datasetcited by 215
  4. 2017Onsets and Frames: Dual-Objective Piano Transcriptioncited by 93
  5. 2019Cutting Music Source Separation Some Slakh: A Dataset to Study the Impact of Training Data Quality and Quantitycited by 86
  6. 2020POP909: A Pop-song Dataset for Music Arrangement Generationcited by 83
  7. 2021MT3: Multi-Task Multitrack Music Transcriptioncited by 70
  8. 2020High-resolution Piano Transcription with Pedals by Regressing Onset and Offset Timescited by 61
  9. 2021Sequence-to-Sequence Piano Transcription with Transformerscited by 48
  10. 2019Encoding Musical Style with Transformer Autoencoderscited by 35
  11. 2019Simultaneous Separation and Transcription of Mixtures with Multiple Polyphonic and Percussive Instrumentscited by 17
  12. 2019Adversarial Learning for Improved Onsets and Frames Music Transcriptioncited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 5; 2025: 3; 2026: 2.

10 papers.

  1. 2024Music Style Transfer with Time-Varying Inversion of Diffusion Modelscited by 9
  2. 2025Controllable Video-to-Music Generation with Multiple Time-Varying Conditionscited by 3
  3. 2024BandCondiNet: Parallel Transformers-based Conditional Popular Music Generation with Multi-View Featurescited by 2
  4. 2024PIAST: A Multimodal Piano Dataset with Audio, Symbolic and Textcited by 2
  5. 2024AMT-APC: Automatic Piano Cover by Fine-Tuning an Automatic Music Transcription Modelcited by 1
  6. 2025Etude: Piano Cover Generation with a Three-Stage Approach -- Extract, strucTUralize, and DEcodecited by 1
  7. 2024Tuning Music Education: AI-Powered Personalization in Learning Musiccited by 0
  8. 2025Fine-Tuning MIDI-to-Audio Alignment using a Neural Network on Piano Roll and CQT Representationscited by 0
  9. 2026MPEcho: A Melody and Phoneme-Aware Generative Framework for Controllable Cover Song Generationcited by 0
  10. 2026Learning Music Style for Piano Arrangement Through Cross-Modal Bootstrappingcited by 0