Evaluating Novelty in AI-Generated Research Plans Using Multi-Workflow LLM Pipelines
Not on the map. Why?
Abstract (arXiv)
The integration of Large Language Models (LLMs) into the scientific ecosystem raises fundamental questions about the creativity and originality of AI-generated research. Recent work has identified ``smart plagiarism'' as a concern in single-step prompting approaches, where models reproduce existing ideas with terminological shifts. This paper investigates whether agentic workflows -- multi-step systems employing iterative reasoning, evolutionary search, and recursive decomposition -- can generate more novel and feasible research plans. We benchmark five reasoning architectures: Reflection-based iterative refinement, Sakana AI v2 evolutionary algorithms, Google Co-Scientist multi-agent framework, GPT Deep Research (GPT-5.1) recursive decomposition, and Gemini~3 Pro multimodal long-context pipeline. Using evaluations from thirty proposals each on novelty, feasibility, and impact, we find that decomposition-based and long-context workflows achieve mean novelty of 4.17/5, while reflection-based approaches score significantly lower (2.33/5). Results reveal varied performance across research domains, with high-performing workflows maintaining feasibility without sacrificing creativity. These findings support the view that carefully designed multi-stage agentic workflows can advance AI-assisted research ideation.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 2 of its 8 references that are in the map. First posted on arXiv 24 Dec 2025.
Builds on
2 of 8 references.
References · 2
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2025All That Glitters is Not Novel: Plagiarism in AI Generated Researchcited by 17
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025SciReplicate-Bench: Benchmarking LLMs in Agent-driven Algorithmic Reproduction from Research Papers
- 2026From Research Question to Scientific Workflow: Leveraging Agentic AI for Science Automation
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap
- 2025InnovatorBench: Evaluating Agents' Ability to Conduct Innovative LLM Research
- 2025Exploring Design of Multi-Agent LLM Dialogues for Research Ideation
- 2025Idea2Plan: Exploring AI-Powered Research Planning
- 2025Large Language Models for Scientific Idea Generation: A Creativity-Centered Survey
- 2026IDEAgent: Agentic Quality-Diversity Search for Research Idea Generation