mlsanityData to 14 Oct 2026

ComfyUI-Copilot: An Intelligent Assistant for Automated Workflow Development

arXiv 2506.05010 ↗First posted 5 Jun 2025cs.CL cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

We introduce ComfyUI-Copilot, a large language model-powered plugin designed to enhance the usability and efficiency of ComfyUI, an open-source platform for AI-driven art creation. Despite its flexibility and user-friendly interface, ComfyUI can present challenges to newcomers, including limited documentation, model misconfigurations, and the complexity of workflow design. ComfyUI-Copilot addresses these challenges by offering intelligent node and model recommendations, along with automated one-click workflow construction. At its core, the system employs a hierarchical multi-agent framework comprising a central assistant agent for task delegation and specialized worker agents for different usages, supported by our curated ComfyUI knowledge bases to streamline debugging and deployment. We validate the effectiveness of ComfyUI-Copilot through both offline quantitative evaluations and online user feedback, showing that it accurately recommends nodes and accelerates workflow development. Additionally, use cases illustrate that ComfyUI-Copilot lowers entry barriers for beginners and enhances workflow efficiency for experienced users. The ComfyUI-Copilot installation package and a demo video are available at https://github.com/AIDC-AI/ComfyUI-Copilot.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 22 of its 34 references that are in the map. First posted on arXiv 5 Jun 2025.

Builds on

22 of 34 references.

References · 22

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  5. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  6. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  7. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  8. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  9. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
  10. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
  11. 2024Agent S: An Open Agentic Framework that Uses Computers Like a Humancited by 187
  12. 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 144
10 more
  1. 2024Improving Text-to-Image Consistency via Automatic Prompt Optimizationcited by 90
  2. 2023Agent Lumos: Unified and Modular Training for Open-Source Language Agentscited by 72
  3. 2023Towards Reasoning in Large Language Models via Multi-Agent Peer Review Collaborationcited by 51
  4. 2024ComfyBench: Benchmarking LLM-based Agents in ComfyUI for Autonomously Designing Collaborative AI Systemscited by 30
  5. 2024Small Agent Can Also Rock! Empowering Small Language Models as Hallucination Detectorcited by 20
  6. 2024Boosting Latent Diffusion with Perceptual Objectivescited by 20
  7. 2024From the Least to the Most: Building a Plug-and-Play Visual Reasoner via Data Synthesiscited by 17
  8. 2025A Unified Agentic Framework for Evaluating Conditional Image Generationcited by 15
  9. 2020Accurate and Lightweight Image Super-Resolution with Model-Guided Deep Unfolding Networkcited by 12
  10. 2024ComfyGI: Automatic Improvement of Image Generation Workflowscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 7.

11 papers.

  1. 2025Magentic-UI: Towards Human-in-the-loop Agentic Systemscited by 43
  2. 2025ComfyUI-R1: Exploring Reasoning Models for Workflow Generationcited by 15
  3. 2026Efficient Failure Management for Multi-Agent Systems with Reasoning Trace Representationcited by 6
  4. 2025Node-Based Editing for Multimodal Generation of Text, Audio, Image, and Videocited by 3
  5. 2026SymbOmni: Evolving Agentic Omni Models via Symbolic Concept Learningcited by 2
  6. 2026Knowledge-Centric Agents for Workflow Generation in ComfyUIcited by 2
  7. 2026JarvisHub: An Open Harness for Canvas-Native Multimodal Creative Agentscited by 1
  8. 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
  9. 2025A Low-Code Methodology for Developing AI Kiosks: a Case Study with the DIZEST Platformcited by 0
  10. 2026LLM-based Visual Code Completion for Aerospace Geometric Designcited by 0
  11. 2026TemplateCraft: Agentic Visual Template Generationcited by 0