mlsanityData to 14 Oct 2026

Creative Problem Solving in Large Language and Vision Models -- What Would it Take?

arXiv 2405.01453 ↗First posted 2 May 2024cs.AI cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

We advocate for a strong integration of Computational Creativity (CC) with research in large language and vision models (LLVMs) to address a key limitation of these models, i.e., creative problem solving. We present preliminary experiments showing how CC principles can be applied to address this limitation. Our goal is to foster discussions on creative problem solving in LLVMs and CC at prestigious ML venues. Our code is available at: https://github.com/lnairGT/creative-problem-solving-LLMs

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 40 of its 85 references that are in the map. First posted on arXiv 2 May 2024.

Builds on

40 of 85 references.

References · 40

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  4. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  5. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
  6. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  7. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  8. 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,230
  9. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
  10. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
  11. 2022Editing Models with Task Arithmeticcited by 1,120
  12. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
28 more
  1. 2022Transformers learn in-context by gradient descentcited by 732
  2. 2021Learning To Retrieve Prompts for In-Context Learningcited by 648
  3. 2021Merging Models with Fisher-Weighted Averagingcited by 621
  4. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 574
  5. 2023Simple and Controllable Music Generationcited by 488
  6. 2023Alphazero-like Tree-Search can Guide Large Language Model Decoding and Trainingcited by 295
  7. 2023Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Planningcited by 207
  8. 2023Guiding Pretraining in Reinforcement Learning with Large Language Modelscited by 187
  9. 2023OneLLM: One Framework to Align All Modalities with Languagecited by 187
  10. 2023Planning with Large Language Models for Code Generationcited by 182
  11. 2023ADaPT: As-Needed Decomposition and Planning with Language Modelscited by 177
  12. 2022MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoningcited by 156
  13. 2023Generalized Planning in PDDL Domains with Pretrained Large Language Modelscited by 139
  14. 2021Towards artificial general intelligence via a multimodal foundation modelcited by 112
  15. 2022CommonsenseQA 2.0: Exposing the Limits of AI through Gamificationcited by 109
  16. 2023On the Creativity of Large Language Modelscited by 57
  17. 2023PlayFusion: Skill Acquisition via Diffusion from Language-Annotated Playcited by 50
  18. 2024RePLan: Robotic Replanning with Perception and Language Modelscited by 41
  19. 2023Interactive Task Planning with Language Modelscited by 37
  20. 2024LLM Augmented LLMs: Expanding Capabilities through Compositioncited by 35
  21. 2023MacGyver: Are Large Language Models Creative Problem Solvers?cited by 34
  22. 2023Large Language Models are Fixated by Red Herrings: Exploring Creative Problem Solving and Einstellung Effect using the Only Connect Wall Datasetcited by 17
  23. 2023PathFinder: Guided Search over Multi-Step Reasoning Pathscited by 12
  24. 2023LgTS: Dynamic Task Sampling using LLM-generated sub-goals for Reinforcement Learning Agentscited by 11
  25. 2023Brain in a Vat: On Missing Pieces Towards Artificial General Intelligence in Large Language Modelscited by 6
  26. 2020Multimodal Material Classification for Robots using Spectroscopy and High Resolution Texture Imagingcited by 5
  27. 2022Creative Problem Solving in Artificially Intelligent Agents: A Survey and Frameworkcited by 4
  28. 2023Unleashing the Creative Mind: Language Model As Hierarchical Policy For Improved Exploration on Challenging Problem Solvingcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 3.

7 papers.

  1. 2025Creative Preference Optimizationcited by 25
  2. 2024Evaluating Creative Short Story Generation in Humans and Large Language Modelscited by 21
  3. 2025GODBench: A Benchmark for Multimodal Large Language Models in Video Comment Artcited by 5
  4. 2025GuessBench: Sensemaking Multimodal Creativity in the Wildcited by 1
  5. 2026Algebraic Quantum Intelligence: A New Framework for Reproducible Machine Creativitycited by 0
  6. 2026Playing with Words, Improving with Rewards: Training Language Models for Creative Associationcited by 0
  7. 2026Evaluating LLM Creativity through Long-Tail Performancecited by 0