LLMs can Realize Combinatorial Creativity: Generating Creative Ideas via LLMs for Scientific Research
Not on the map. Why?
Abstract (arXiv)
Scientific idea generation has been extensively studied in creativity theory and computational creativity research, providing valuable frameworks for understanding and implementing creative processes. However, recent work using Large Language Models (LLMs) for research idea generation often overlooks these theoretical foundations. We present a framework that explicitly implements combinatorial creativity theory using LLMs, featuring a generalization-level retrieval system for cross-domain knowledge discovery and a structured combinatorial process for idea generation. The retrieval system maps concepts across different abstraction levels to enable meaningful connections between disparate domains, while the combinatorial process systematically analyzes and recombines components to generate novel solutions. Experiments on the OAG-Bench dataset demonstrate our framework's effectiveness, consistently outperforming baseline approaches in generating ideas that align with real research developments (improving similarity scores by 7%-10% across multiple metrics). Our results provide strong evidence that LLMs can effectively realize combinatorial creativity when guided by appropriate theoretical frameworks, contributing both to practical advancement of AI-assisted research and theoretical understanding of machine creativity.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 12 of its 20 references that are in the map. First posted on arXiv 18 Dec 2024.
Builds on
12 of 20 references.
References · 12
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2024Qwen2 Technical Reportcited by 2,120
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 430
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 427
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 363
- 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 210
- 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 179
- 2023Large Language Models are Zero Shot Hypothesis Proposerscited by 45
- 2024Can Large Language Models Unlock Novel Scientific Research Ideas?cited by 24
- 2024OAG-Bench: A Human-Curated Benchmark for Academic Graph Miningcited by 14
Built on by
Citing papers per year: 2024: 1; 2025: 8; 2026: 8.
17 papers.
Sort:
By area:
- 2025SciReplicate-Bench: Benchmarking LLMs in Agent-driven Algorithmic Reproduction from Research Paperscited by 43
- 2025AI Scientists Fail Without Strong Implementation Capabilitycited by 21
- 2025The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvementscited by 15
- 2026AI for Auto-Research: Roadmap & User Guidecited by 11
- 2026Measuring the Gap Between Human and LLM Research Ideascited by 10
- 2025Evolving Roles of LLMs in Scientific Innovation: Assistant, Collaborator, Scientist, and Evaluatorcited by 9
- 2025XtraGPT: Context-Aware and Controllable Academic Paper Revision via Human-AI Collaborationcited by 7
- 2025Measuring Combinatorial Creativity in Large Language Models and Humanscited by 7
- 2026Emergent Languages in Populations of Language Model Agents: From Token Efficiency to Oversight Evasioncited by 2
- 2026Automated Creativity Evaluation of Language Models Across Open-Ended Taskscited by 2
- 2024Extracting effective solutions hidden in large language models via generated comprehensive specialists: case studies in developing electronic devicescited by 1
- 2025The Variance Paradox: How AI Reduces Diversity but Increases Noveltycited by 1
5 more
- 2026Assessing the Effect of Cross-Domain Mapping on Creativity in Humans and Large Language Modelscited by 1
- 2026TCA-SIR: Learning Target-Conditioned Abstractions for Scientific Inspiration Retrievalcited by 1
- 2025Universe of Thoughts: Enabling Creative Reasoning with Large Language Modelscited by 0
- 2026Malicious Repurposing of Open Science Artefacts by Using Large Language Modelscited by 0
- 2026Reinforcing Agentic Creativity in Scientific Ideation with Night Sciencecited by 0
- 2026Reinforcing Agentic Creativity in Scientific Ideation with Night Science28 Sep 2026
- 2026TCA-SIR: Learning Target-Conditioned Abstractions for Scientific Inspiration Retrieval30 Jul 2026
- 2026Measuring the Gap Between Human and LLM Research Ideas1 Jul 2026
- 2026Automated Creativity Evaluation of Language Models Across Open-Ended Tasks10 Jun 2026
- 2026Emergent Languages in Populations of Language Model Agents: From Token Efficiency to Oversight Evasion29 May 2026
- 2026AI for Auto-Research: Roadmap & User Guide18 May 2026
- 2026Assessing the Effect of Cross-Domain Mapping on Creativity in Humans and Large Language Models19 Mar 2026
- 2026Malicious Repurposing of Open Science Artefacts by Using Large Language Models26 Jan 2026
- 2025Universe of Thoughts: Enabling Creative Reasoning with Large Language Models25 Nov 2025
- 2025Measuring Combinatorial Creativity in Large Language Models and Humans25 Sep 2025
- 2025The Variance Paradox: How AI Reduces Diversity but Increases Novelty20 Aug 2025
- 2025Evolving Roles of LLMs in Scientific Innovation: Assistant, Collaborator, Scientist, and Evaluator16 Jul 2025
5 more
- 2025The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements27 Jun 2025
- 2025AI Scientists Fail Without Strong Implementation Capability2 Jun 2025
- 2025XtraGPT: Context-Aware and Controllable Academic Paper Revision via Human-AI Collaboration16 May 2025
- 2025SciReplicate-Bench: Benchmarking LLMs in Agent-driven Algorithmic Reproduction from Research Papers31 Mar 2025
- 2024Extracting effective solutions hidden in large language models via generated comprehensive specialists: case studies in developing electronic devices31 Dec 2024
- 2025SciReplicate-Bench: Benchmarking LLMs in Agent-driven Algorithmic Reproduction from Research Paperscited by 43
- 2026Emergent Languages in Populations of Language Model Agents: From Token Efficiency to Oversight Evasioncited by 2
- 2026Reinforcing Agentic Creativity in Scientific Ideation with Night Sciencecited by 0
- 2026Reinforcing Agentic Creativity in Scientific Ideation with Night Science28 Sep 2026
- 2026Emergent Languages in Populations of Language Model Agents: From Token Efficiency to Oversight Evasion29 May 2026
- 2025SciReplicate-Bench: Benchmarking LLMs in Agent-driven Algorithmic Reproduction from Research Papers31 Mar 2025
- 2025AI Scientists Fail Without Strong Implementation Capabilitycited by 21
- 2025The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvementscited by 15
- 2026AI for Auto-Research: Roadmap & User Guidecited by 11
- 2026Measuring the Gap Between Human and LLM Research Ideascited by 10
- 2025Evolving Roles of LLMs in Scientific Innovation: Assistant, Collaborator, Scientist, and Evaluatorcited by 9
- 2025XtraGPT: Context-Aware and Controllable Academic Paper Revision via Human-AI Collaborationcited by 7
- 2025Measuring Combinatorial Creativity in Large Language Models and Humanscited by 7
- 2026Automated Creativity Evaluation of Language Models Across Open-Ended Taskscited by 2
- 2024Extracting effective solutions hidden in large language models via generated comprehensive specialists: case studies in developing electronic devicescited by 1
- 2025The Variance Paradox: How AI Reduces Diversity but Increases Noveltycited by 1
- 2026Assessing the Effect of Cross-Domain Mapping on Creativity in Humans and Large Language Modelscited by 1
- 2026TCA-SIR: Learning Target-Conditioned Abstractions for Scientific Inspiration Retrievalcited by 1
12 most cited of 13 All 13 (JSON)
- 2026TCA-SIR: Learning Target-Conditioned Abstractions for Scientific Inspiration Retrieval30 Jul 2026
- 2026Measuring the Gap Between Human and LLM Research Ideas1 Jul 2026
- 2026Automated Creativity Evaluation of Language Models Across Open-Ended Tasks10 Jun 2026
- 2026AI for Auto-Research: Roadmap & User Guide18 May 2026
- 2026Assessing the Effect of Cross-Domain Mapping on Creativity in Humans and Large Language Models19 Mar 2026
- 2026Malicious Repurposing of Open Science Artefacts by Using Large Language Models26 Jan 2026
- 2025Measuring Combinatorial Creativity in Large Language Models and Humans25 Sep 2025
- 2025The Variance Paradox: How AI Reduces Diversity but Increases Novelty20 Aug 2025
- 2025Evolving Roles of LLMs in Scientific Innovation: Assistant, Collaborator, Scientist, and Evaluator16 Jul 2025
- 2025The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT Improvements27 Jun 2025
- 2025AI Scientists Fail Without Strong Implementation Capability2 Jun 2025
- 2025XtraGPT: Context-Aware and Controllable Academic Paper Revision via Human-AI Collaboration16 May 2025
12 newest of 13 All 13 (JSON)