mlsanityData to 7 Oct 2026

VisionCreator: A Native Visual-Generation Agentic Model with Understanding, Thinking, Planning and Creation

arXiv 2603.02681 ↗First posted 3 Mar 2026cs.CVcited by 2

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Visual content creation tasks demand a nuanced understanding of design conventions and creative workflows-capabilities challenging for general models, while workflow-based agents lack specialized knowledge for autonomous creative planning. To overcome these challenges, we propose VisionCreator, a native visual-generation agentic model that unifies Understanding, Thinking, Planning, and Creation (UTPC) capabilities within an end-to-end learnable framework. Our work introduces four key contributions: (i) VisGenData-4k and its construction methodology using metacognition-based VisionAgent to generate high-quality creation trajectories with explicit UTPC structures; (ii) The VisionCreator agentic model, optimized through Progressive Specialization Training (PST) and Virtual Reinforcement Learning (VRL) within a high-fidelity simulated environment, enabling stable and efficient acquisition of UTPC capabilities for complex creation tasks; (iii) VisGenBench, a comprehensive benchmark featuring 1.2k test samples across diverse scenarios for standardized evaluation of multi-step visual creation capabilities; (iv) Remarkably, our VisionCreator-8B/32B models demonstrate superior performance over larger closed-source models across multiple evaluation dimensions. Overall, this work provides a foundation for future research in visual-generation agentic systems.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 31 of its 37 references that are in the map. First posted on arXiv 3 Mar 2026.

Builds on

31 of 37 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Automated Movie Generation via Multi-Agent CoT Planning10 Mar
  2. 2025MM-StoryAgent: Immersive Narrated Storybook Video Generation with a Multi-Agent Paradigm across Text, Image and Audio7 Mar

Other references · 29

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  4. 2022Scalable Diffusion Models with Transformerscited by 5,931
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  7. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  8. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  9. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  10. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
  11. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  12. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
17 more
  1. 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 297
  2. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
  3. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
  4. 2024ToolACE: Winning the Points of LLM Function Callingcited by 204
  5. 2024Fluid: Scaling Autoregressive Text-to-image Generative Models with Continuous Tokenscited by 147
  6. 2023M3IT: A Large-Scale Dataset towards Multi-Modal Multilingual Instruction Tuningcited by 126
  7. 2025Emu3.5: Native Multimodal Models are World Learnerscited by 119
  8. 2024xLAM: A Family of Large Action Models to Empower AI Agent Systemscited by 108
  9. 2025Chain-of-Agents: End-to-End Agent Foundation Models via Multi-Agent Distillation and Agentic RLcited by 75
  10. 2025Captain Cinema: Towards Short Movie Generationcited by 48
  11. 2024OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flowscited by 45
  12. 2024ComfyBench: Benchmarking LLM-based Agents in ComfyUI for Autonomously Designing Collaborative AI Systemscited by 30
  13. 2024Next Patch Prediction for Autoregressive Visual Generationcited by 25
  14. 2025ComfyMind: Toward General-Purpose Generation via Tree-Based Planning and Reactive Feedbackcited by 15
  15. 2025ComfyUI-R1: Exploring Reasoning Models for Workflow Generationcited by 15
  16. 2025ComfyGPT: A Self-Optimizing Multi-Agent System for Comprehensive ComfyUI Workflow Generationcited by 14
  17. 2024Spider: Any-to-Many Multimodal LLMcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026GenEvolve: Self-Evolving Image Generation Agents via Tool-Orchestrated Visual Experience Distillation
  2. 2026GenClaw: Code-Driven Agentic Image Generation
  3. 2026Gym-V: A Unified Vision Environment System for Agentic Vision Research
  4. 2026COMFYCLAW: Self-Evolving Skill Harnesses for Image Generation Workflows
  5. 2026V-Gym: Enhancing Agentic Visual Reasoning via Skill-Data Co-Evolution
  6. 2023Creative Agents: Empowering Agents with Imagination for Creative Tasks
  7. 2025Simulating the Visual World with Artificial Intelligence: A Roadmap
  8. 2026OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learning