mlsanityData to 7 Oct 2026

OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learning

arXiv 2609.16057 ↗First posted 13 Sep 2026cs.LG cs.AIcited by 2

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Unified multimodal large language models (MLLMs) and multi-agent systems have advanced visual generation. However, three limitations remain. (1) Existing methods often distill task-specific experience with limited generalizability. (2) Reflection is often deferred until task completion. (3) Knowledge is often acquired only in response to downstream task demands. To address these limitations, we introduce OmniHarness, a framework for generalizable visual generation via symbolic policy learning. OmniHarness abstracts verified executions into symbolic policies for visual generation task families, capturing shared procedures and applicability conditions while removing instance-specific inputs. The harness instantiates, adapts, and composes these policies for new tasks. Intermediate verification guides refinement and failure recovery during execution. Through self-directed inquiry, OmniHarness autonomously generates and executes practice tasks near its capability limits before downstream objectives are specified. Execution feedback continually refines the policies while model parameters remain fixed. Experiments across six benchmarks, three MLLM backbones, and three visual agent frameworks demonstrate strong performance and continual capability expansion. On ComfyBench's Creative tasks, OmniHarness achieves a 95.0% resolve rate, exceeding the strongest baseline by 27.5 percentage points. Frozen policy snapshots improve existing visual agent systems through plug-and-play reuse.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 60 of its 73 references that are in the map. First posted on arXiv 13 Sep 2026.

Builds on

60 of 73 references.

References · 60

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  8. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  9. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  10. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  11. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  12. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
38 more
  1. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  2. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
  3. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
  4. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  5. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  6. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
  7. 2023Generative Multimodal Models are In-Context Learnerscited by 446
  8. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  9. 2024OmniGen: Unified Image Generationcited by 388
  10. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
  11. 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 290
  12. 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generationcited by 249
  13. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
  14. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
  15. 2024World Model on Million-Length Video And Language With Blockwise RingAttentioncited by 196
  16. 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
  17. 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 174
  18. 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 162
  19. 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?cited by 105
  20. 2025Multi-Agent Collaboration via Evolving Orchestrationcited by 102
  21. 2025How Memory Management Impacts LLM Agents: An Empirical Study of Experience-Following Behaviorcited by 95
  22. 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 69
  23. 2013Active Learning of Inverse Models with Intrinsically Motivated Goal Exploration in Robotscited by 56
  24. 2024Orthus: Autoregressive Interleaved Image-Text Generation with Modality-Specific Headscited by 44
  25. 2025GenEval 2: Addressing Benchmark Drift in Text-to-Image Evaluationcited by 42
  26. 2026Harness VLA: Steering Frozen VLAs into Reliable Manipulation Primitives via Memory-Guided Agentscited by 37
  27. 2024ComfyBench: Benchmarking LLM-based Agents in ComfyUI for Autonomously Designing Collaborative AI Systemscited by 30
  28. 2025JarvisEvo: Towards a Self-Evolving Photo Editing Agent with Synergistic Editor-Evaluator Optimizationcited by 30
  29. 2025StepORLM: A Self-Evolving Framework With Generative Process Supervision For Operations Research Language Modelscited by 26
  30. 2026ReCreate: Reasoning and Creating Domain Agents Driven by Experiencecited by 22
  31. 2026Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generationcited by 19
  32. 2024InsightEdit: Towards Better Instruction Following for Image Editingcited by 17
  33. 2025ComfyMind: Toward General-Purpose Generation via Tree-Based Planning and Reactive Feedbackcited by 15
  34. 2025MIRA: Multimodal Iterative Reasoning Agent for Image Editingcited by 15
  35. 2026GenEvolve: Self-Evolving Image Generation Agents via Tool-Orchestrated Visual Experience Distillationcited by 15
  36. 2025ComfyGPT: A Self-Optimizing Multi-Agent System for Comprehensive ComfyUI Workflow Generationcited by 14
  37. 2025Real-Time Reasoning Agents in Evolving Environmentscited by 13
  38. 2026On Safety Risks in Experience-Driven Self-Evolving Agentscited by 12

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ManimAgent: Self-Evolving Multimodal Agents for Visual Education
  2. 2025ThinkGen: Generalized Thinking for Visual Generation
  3. 2026VisGym: Diverse, Customizable, Scalable Environments for Multimodal Agents
  4. 2026MMSkills: Towards Multimodal Skills for General Visual Agents
  5. 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoning
  6. 2026Agentic Visual Generation: From Generative Models to Agentic Control
  7. 2026In-Context VLA: Endowing Vision-Language-Action Models with Language via In-Context Post-Training and Agentic Tool Use
  8. 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning