mlsanityData to 7 Oct 2026

Creativity and Machine Learning: A Survey

arXiv 2104.02726 ↗First posted 6 Apr 2021cs.LG cs.AI cs.CYcited by 21

Not on the map. Why?

Abstract (arXiv)

There is a growing interest in the area of machine learning and creativity. This survey presents an overview of the history and the state of the art of computational creativity theories, key machine learning techniques (including generative deep learning), and corresponding automatic evaluation methods. After presenting a critical discussion of the key contributions in this area, we outline the current research challenges and emerging opportunities in this field.

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 128 of its 344 references that are in the map. First posted on arXiv 6 Apr 2021.

Builds on

128 of 344 references.

References · 128

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  6. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  7. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  8. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  9. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  10. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  11. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  12. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
38 more
  1. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  2. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  4. 2017Neural Discrete Representation Learningcited by 4,650
  5. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  6. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  7. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  8. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  9. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  10. 2017Deep reinforcement learning from human preferencescited by 3,846
  11. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  12. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  13. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  14. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  15. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  16. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  17. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  18. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  19. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  20. 2020Learning to summarize from human feedbackcited by 2,562
  21. 2014Conditional Generative Adversarial Netscited by 2,152
  22. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
  23. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
  24. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  25. 2021ViViT: A Video Vision Transformercited by 1,610
  26. 2019Generating Long Sequences with Sparse Transformerscited by 1,523
  27. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
  28. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  29. 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
  30. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
  31. 2021Transformers in Vision: A Surveycited by 1,009
  32. 2019An Introduction to Variational Autoencoderscited by 997
  33. 2016Conditional Image Generation with PixelCNN Decoderscited by 859
  34. 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 858
  35. 2016Pixel Recurrent Neural Networkscited by 814
  36. 2018Self-Attention Generative Adversarial Networkscited by 809
  37. 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 793
  38. 2018Image Transformercited by 770

50 most cited of 128 All 128 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 4; 2023: 5; 2024: 4; 2025: 4; 2026: 2.

21 papers.

Sort:

By area:

  1. 2021Deep Generative Models in Engineering Design: A Reviewcited by 103
  2. 2023On the Creativity of Large Language Modelscited by 57
  3. 2021Copyright in Generative Deep Learningcited by 29
  4. 2024Pron vs Prompt: Can Large Language Models already Challenge a World-Class Fiction Author at Creative Text Writing?cited by 26
  5. 2023Ten Years of Generative Adversarial Nets (GANs): A survey of the state-of-the-artcited by 14
  6. 2023Reinforcement Learning for Generative AI: State of the Art, Opportunities and Open Research Challengescited by 10
  7. 2025Frankentext: Stitching random text fragments into long-form narrativescited by 8
  8. 2024Creativity in AI: Progresses and Challengescited by 7
  9. 2022DeepCreativity: Measuring Creativity with Deep Learning Techniquescited by 6
  10. 2024Do LLMs Agree on the Creativity Evaluation of Alternative Uses?cited by 5
  11. 2022Challenges in creative generative models for music: a divergence maximization perspectivecited by 3
  12. 2023IteraTTA: An interface for exploring both text prompts and audio priors in generating music with text-to-audio modelscited by 3
9 more
  1. 2022Threshold Designer Adaptation: Improved Adaptation for Designers in Co-creative Systemscited by 1
  2. 2023Advancing Perception in Artificial Intelligence through Principles of Cognitive Sciencecited by 1
  3. 2025Thinking Outside the (Gray) Box: A Context-Based Score for Assessing Value and Originality in Neural Text Generationcited by 1
  4. 2022Towards Creativity Characterization of Generative Models via Group-based Subset Scanningcited by 0
  5. 2024Automating Creativitycited by 0
  6. 2025Imagine for Me: Creative Conceptual Blending of Real Images and Text via Blended Attentioncited by 0
  7. 2025Testing chatbots on the creation of encoders for audio conditioned image generationcited by 0
  8. 2026A Creative Agent is Worth a 64-Token Templatecited by 0
  9. 2026Seeking the Unfamiliar but Memorable: Conceptual Creativity as Meta-Learningcited by 0