mlsanityData to 7 Oct 2026

Beyond One Path: Evaluating and Enhancing Divergent Thinking in Interactive LLM Agents

arXiv 2605.28465 ↗First posted 27 May 2026cs.CLcited by 0

On the map: LLM reasoning → Reasoning benchmarks and evaluation

also in 1 more
Abstract (arXiv)

Divergent thinking is a core dimension of creativity, yet existing evaluations of Large Language Models (LLMs) treat them as single-turn text generations, failing to capture how an agent reasons through iterative interaction. To address this, we introduce MUTATE, an interactive benchmark designed to evaluate agentic divergent thinking at two levels: path-level, where an agent discovers multiple alternative paths to the same goal, and action-level, where individual actions require non-typical, mechanism-shifting object uses. Unlike success-only evaluations, MUTATE scores both completed paths and off-path attempts, capturing divergent reasoning that conventional success rates discard. Our experiments with frontier LLMs reveal a structural blind spot in existing frameworks: when exposed to immediate convergence pressure, they tend to fall into immediate action fixation, failing to improve action-level divergence. To overcome this, we propose ReDNA, which separates unconstrained divergent candidate generation from convergent constraint selection. ReDNA significantly outperforms prior methods across both divergence levels and generalizes effectively to an external creativity environment. We also confirm its success stems from a qualitative enhancement of resilient divergent reasoning rather than simple environmental exploration.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 7 of its 30 references that are in the map. First posted on arXiv 27 May 2026.

Builds on

7 of 30 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Qwen3 Technical Report14 May
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Models6 Oct

Other references · 5

  1. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  2. 2025OpenAI GPT-5 System Cardcited by 910
  3. 2024Understanding the planning of LLM agents: A surveycited by 414
  4. 2025CreativityPrism: A Cross-Domain Evaluation Framework for Large Language Model Creativitycited by 3
  5. 2025MARCH: Evaluating the Intersection of Ambiguity Interpretation and Multi-hop Inferencecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026CreativityNeuro: Steering Language Model Weights to Improve Divergent Thinking and Reduce Mode Collapse
  2. 2024EscapeBench: Towards Advancing Creative Intelligence of Language Model Agents
  3. 2026Multi-agent AI systems outperform human teams in creativity
  4. 2026The Reasoning-Creativity Trade-off: Toward Creativity-Driven Problem Solving
  5. 2026IDEAgent: Agentic Quality-Diversity Search for Research Idea Generation
  6. 2026Diversity Collapse in Multi-Agent LLM Systems: Structural Coupling and Collective Failure in Open-Ended Idea Generation
  7. 2026Creative Generation via Multi-Agent Debate: Does Debate Suppress Diversity?
  8. 2024Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinking