mlsanityData to 7 Oct 2026

This Time with Feeling: Learning Expressive Musical Performance

arXiv 1808.03715 ↗First posted 10 Aug 2018cs.SD cs.LG eess.AScited by 67

Not on the map. Why?

Abstract (arXiv)

Music generation has generally been focused on either creating scores or interpreting them. We discuss differences between these two problems and propose that, in fact, it may be valuable to work in the space of direct it performance generation: jointly predicting the notes it and it also their expressive timing and dynamics. We consider the significance and qualities of the data set needed for this. Having identified both a problem domain and characteristics of an appropriate data set, we show an LSTM-based recurrent network model that subjectively performs quite well on this task. Critically, we provide generated examples. We also include feedback from professional composers and musicians about some of these examples.

Key facts. Cited by 67 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Aug 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 18; 2022: 10; 2023: 9; 2024: 12; 2025: 10; 2026: 8.

67 papers.

Sort:

By area:

  1. 2021Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphscited by 109
  2. 2021MusicBERT: Symbolic Music Understanding with Large-Scale Pre-Trainingcited by 89
  3. 2024ChatMusician: Understanding and Generating Music Intrinsically with LLMcited by 67
  4. 2021Sequence-to-Sequence Piano Transcription with Transformerscited by 48
  5. 2021MuseMorphose: Full-Song and Fine-Grained Piano Music Style Transfer with One Transformer VAEcited by 39
  6. 2022Quantized GAN for Complex Music Generation from Dance Videoscited by 37
  7. 2023Anticipatory Music Transformercited by 35
  8. 2023miditok: A Python package for MIDI file tokenizationcited by 26
  9. 2021Variable-rate discrete representation learningcited by 24
  10. 2021The Piano Inpainting Applicationcited by 23
  11. 2023Byte Pair Encoding for Symbolic Musiccited by 19
  12. 2023V2Meow: Meowing to the Visual Beat via Video-to-Music Generationcited by 18
38 more
  1. 2021Generating Lead Sheets with Affect: A Novel Conditional seq2seq Frameworkcited by 17
  2. 2022MusIAC: An extensible generative framework for Music Infilling Applications with multi-level Controlcited by 17
  3. 2022A Domain-Knowledge-Inspired Music Embedding Space and a Novel Attention Mechanism for Symbolic Music Modelingcited by 17
  4. 2021Variable-Length Music Score Infilling via XLNet and Musically Specialized Positional Encodingcited by 14
  5. 2021Hierarchical Recurrent Neural Networks for Conditional Melody Generation with Long-term Structurecited by 12
  6. 2021BERT-like Pre-training for Symbolic Piano Music Classification Taskscited by 12
  7. 2022Deep Performer: Score-to-Audio Music Performance Synthesiscited by 12
  8. 2022Symbolic music generation conditioned on continuous-valued emotionscited by 12
  9. 2024CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Modelscited by 12
  10. 2021Structure-Enhanced Pop Music Generation via Harmony-Aware Learningcited by 11
  11. 2022A Review of Intelligent Music Generation Systemscited by 11
  12. 2024Natural Language Processing Methods for Symbolic Music Generation and Information Retrieval: a Surveycited by 10
  13. 2025Survey on the Evaluation of Generative Models in Musiccited by 10
  14. 2021Is Disentanglement enough? On Latent Representations for Controllable Music Generationcited by 7
  15. 2021Score Transformer: Generating Musical Score from Note-level Representationcited by 7
  16. 2022Conditional Drums Generation using Compound Word Representationscited by 7
  17. 2025Scaling Self-Supervised Representation Learning for Symbolic Piano Performancecited by 7
  18. 2023Impact of time and note duration tokenizations on deep learning symbolic music modelingcited by 6
  19. 2024An Order-Complexity Aesthetic Assessment Model for Aesthetic-aware Music Recommendationcited by 6
  20. 2024Motifs, Phrases, and Beyond: The Modelling of Structure in Symbolic Music Generationcited by 6
  21. 2023WuYun: Exploring hierarchical skeleton-guided melody generation using knowledge-enhanced deep learningcited by 5
  22. 2023N-Gram Unsupervised Compoundation and Feature Injection for Better Symbolic Music Understandingcited by 5
  23. 2024PerTok: Expressive Encoding and Modeling of Symbolic Musical Ideas and Variationscited by 4
  24. 2025A Comprehensive Survey on Generative AI for Video-to-Music Generationcited by 4
  25. 2025Evaluating Human-AI Interaction via Usability, User Experience and Acceptance Measures for MMM-C: A Creative AI System for Music Compositioncited by 4
  26. 2025Moonbeam: A MIDI Foundation Model Using Both Absolute and Relative Music Attributescited by 4
  27. 2021Expressive Communication: A Common Framework for Evaluating Developments in Generative Models and Steering Interfacescited by 3
  28. 2022A Novel Multi-Task Learning Method for Symbolic Music Emotion Recognitioncited by 3
  29. 2022A Survey on Artificial Intelligence for Music Generation: Agents, Domains and Perspectivescited by 3
  30. 2024MOSA: Music Motion with Semantic Annotation Dataset for Cross-Modal Music Processingcited by 3
  31. 2022On the Typicality of Musical Sequencescited by 2
  32. 2023From Words to Music: A Study of Subword Tokenization Techniques in Symbolic Music Generationcited by 2
  33. 2024Multi-view MidiVAE: Fusing Track- and Bar-view Representations for Long Multi-track Symbolic Music Generationcited by 2
  34. 2025Video Soundtrack Generation by Aligning Emotions and Temporal Boundariescited by 2
  35. 2025Diffusion-based Symbolic Music Generation with Structured State Space Modelscited by 2
  36. 2025Pianist Transformer: Towards Expressive Piano Performance Rendering via Scalable Self-Supervised Pre-Trainingcited by 2
  37. 2026BEAT: Tokenizing and Generating Symbolic Music by Uniform Temporal Stepscited by 2
  38. 2021Musical Speech: A Transformer-based Composition Toolcited by 1

50 most cited of 67 All 67 (JSON)