OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learning
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Unified multimodal large language models (MLLMs) and multi-agent systems have advanced visual generation. However, three limitations remain. (1) Existing methods often distill task-specific experience with limited generalizability. (2) Reflection is often deferred until task completion. (3) Knowledge is often acquired only in response to downstream task demands. To address these limitations, we introduce OmniHarness, a framework for generalizable visual generation via symbolic policy learning. OmniHarness abstracts verified executions into symbolic policies for visual generation task families, capturing shared procedures and applicability conditions while removing instance-specific inputs. The harness instantiates, adapts, and composes these policies for new tasks. Intermediate verification guides refinement and failure recovery during execution. Through self-directed inquiry, OmniHarness autonomously generates and executes practice tasks near its capability limits before downstream objectives are specified. Execution feedback continually refines the policies while model parameters remain fixed. Experiments across six benchmarks, three MLLM backbones, and three visual agent frameworks demonstrate strong performance and continual capability expansion. On ComfyBench's Creative tasks, OmniHarness achieves a 95.0% resolve rate, exceeding the strongest baseline by 27.5 percentage points. Frozen policy snapshots improve existing visual agent systems through plug-and-play reuse.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 60 of its 73 references that are in the map. First posted on arXiv 13 Sep 2026.
Builds on
60 of 73 references.
References · 60
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
38 more
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
- 2023Generative Multimodal Models are In-Context Learnerscited by 446
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2024OmniGen: Unified Image Generationcited by 388
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
- 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 290
- 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generationcited by 249
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
- 2024World Model on Million-Length Video And Language With Blockwise RingAttentioncited by 196
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
- 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 174
- 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 162
- 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?cited by 105
- 2025Multi-Agent Collaboration via Evolving Orchestrationcited by 102
- 2025How Memory Management Impacts LLM Agents: An Empirical Study of Experience-Following Behaviorcited by 95
- 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 69
- 2013Active Learning of Inverse Models with Intrinsically Motivated Goal Exploration in Robotscited by 56
- 2024Orthus: Autoregressive Interleaved Image-Text Generation with Modality-Specific Headscited by 44
- 2025GenEval 2: Addressing Benchmark Drift in Text-to-Image Evaluationcited by 42
- 2026Harness VLA: Steering Frozen VLAs into Reliable Manipulation Primitives via Memory-Guided Agentscited by 37
- 2024ComfyBench: Benchmarking LLM-based Agents in ComfyUI for Autonomously Designing Collaborative AI Systemscited by 30
- 2025JarvisEvo: Towards a Self-Evolving Photo Editing Agent with Synergistic Editor-Evaluator Optimizationcited by 30
- 2025StepORLM: A Self-Evolving Framework With Generative Process Supervision For Operations Research Language Modelscited by 26
- 2026ReCreate: Reasoning and Creating Domain Agents Driven by Experiencecited by 22
- 2026Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generationcited by 19
- 2024InsightEdit: Towards Better Instruction Following for Image Editingcited by 17
- 2025ComfyMind: Toward General-Purpose Generation via Tree-Based Planning and Reactive Feedbackcited by 15
- 2025MIRA: Multimodal Iterative Reasoning Agent for Image Editingcited by 15
- 2026GenEvolve: Self-Evolving Image Generation Agents via Tool-Orchestrated Visual Experience Distillationcited by 15
- 2025ComfyGPT: A Self-Optimizing Multi-Agent System for Comprehensive ComfyUI Workflow Generationcited by 14
- 2025Real-Time Reasoning Agents in Evolving Environmentscited by 13
- 2026On Safety Risks in Experience-Driven Self-Evolving Agentscited by 12
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026ManimAgent: Self-Evolving Multimodal Agents for Visual Education
- 2025ThinkGen: Generalized Thinking for Visual Generation
- 2026VisGym: Diverse, Customizable, Scalable Environments for Multimodal Agents
- 2026MMSkills: Towards Multimodal Skills for General Visual Agents
- 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoning
- 2026Agentic Visual Generation: From Generative Models to Agentic Control
- 2026In-Context VLA: Endowing Vision-Language-Action Models with Language via In-Context Post-Training and Agentic Tool Use
- 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning