mlsanityData to 14 Oct 2026

PIAST: A Multimodal Piano Dataset with Audio, Symbolic and Text

arXiv 2411.02551 ↗First posted 4 Nov 2024cs.SD cs.AI cs.MMcited by 2

Not on the map. Why?

Abstract (arXiv)

While piano music has become a significant area of study in Music Information Retrieval (MIR), there is a notable lack of datasets for piano solo music with text labels. To address this gap, we present PIAST (PIano dataset with Audio, Symbolic, and Text), a piano music dataset. Utilizing a piano-specific taxonomy of semantic tags, we collected 9,673 tracks from YouTube and added human annotations for 2,023 tracks by music experts, resulting in two subsets: PIAST-YT and PIAST-AT. Both include audio, text, tag annotations, and transcribed MIDI utilizing state-of-the-art piano transcription and beat tracking models. Among many possible tasks with the multi-modal dataset, we conduct music tagging and retrieval using both audio and MIDI data and report baseline performances to demonstrate its potential as a valuable resource for MIR research.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 18 of its 29 references that are in the map. First posted on arXiv 4 Nov 2024.

Builds on

18 of 29 references.

References · 18

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2018Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Datasetcited by 217
  5. 2021Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphscited by 110
  6. 2021Codified audio language modeling learns useful representations for music information retrievalcited by 64
  7. 2020High-resolution Piano Transcription with Pedals by Regressing Onset and Offset Timescited by 61
  8. 2021EMOPIA: A Multi-Modal Pop Piano Dataset For Emotion Recognition and Emotion-based Music Generationcited by 53
  9. 2019musicnn: Pre-trained convolutional neural networks for music audio taggingcited by 50
  10. 2020GiantMIDI-Piano: A large-scale MIDI dataset for classical piano musiccited by 37
  11. 2021Learning to Generate Music With Sentimentcited by 29
  12. 2023All-In-One Metrical And Functional Structure Analysis With Neighborhood Attentions on Demixed Audiocited by 28
6 more
  1. 2022Toward Universal Text-to-Music Retrievalcited by 18
  2. 2019Zero-shot Learning for Audio-based Music Classification and Taggingcited by 13
  3. 2022Pop2Piano : Pop Audio-based Piano Cover Generationcited by 10
  4. 2022YM2413-MDB: A Multi-Instrumental FM Video Game Music Dataset with Emotion Annotationscited by 7
  5. 2024Enriching Music Descriptions with a Finetuned-LLM and Metadata for Text-to-Music Retrievalcited by 7
  6. 2024Musical Word Embedding for Music Tagging and Retrievalcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.