mlsanityData to 7 Oct 2026

SymbOmni: Evolving Agentic Omni Models via Symbolic Concept Learning

arXiv 2607.12042 ↗First posted 13 Jul 2026cs.CV cs.LGcited by 2

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Visual generation is increasingly ubiquitous in diverse domains, from text-to-image/video synthesis to multimodal interactive creation. Yet prevailing monolithic models remain fundamentally constrained by their inability to learn cumulatively and evolve autonomously, which is a limitation we term the "perpetual novice" problem. They lack mechanisms for structuring experience into reusable knowledge and therefore rely on brittle, "from-scratch" reasoning for each task, resulting in poor compositional generalization and inefficient knowledge retention. Motivated by these limitations, we propose SymbOmni, an agentic omni-model designed for cumulative evolution through Symbolic Concept Learning. At its core is the Symbolic Concept Box, an optimizable memory module that abstracts low-level operations into reusable Symbolic Workflow Instructions. SymbOmni operates through an induction-transduction cycle: experiences are abstracted into symbolic concepts (induction), which are then adaptively composed to solve novel tasks (transduction). The training is done by verbalized backpropagation with language-based feedback to enable continuous self-improvement without gradient-based model fine-tuning. Comprehensive experiments validate that (I) SymbOmni significantly outperforms existing agent-based systems for iterative creation and also surpasses closed-source models (e.g., Nano Banana, GPT-Image-1) in both image quality and task success rates; (II) SymbOmni effectively reduces token consumption by over 40% while maintaining competitive generation quality; and (III) SymbOmni enables effective continual learning by achieving cumulative gains across multiple online-learning benchmarks and setting a new state of the art.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 79 of its 128 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

79 of 128 references.

References · 79

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  6. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  7. 2025Qwen3 Technical Reportcited by 8,195
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  9. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  11. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  12. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
38 more
  1. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  4. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  5. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  6. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  7. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  8. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  9. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  10. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  11. 2025Qwen-Image Technical Reportcited by 973
  12. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  13. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  14. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
  15. 2023ChatDev: Communicative Agents for Software Developmentcited by 893
  16. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  17. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
  18. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  19. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  20. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
  21. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
  22. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  23. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  24. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
  25. 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
  26. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
  27. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
  28. 2023Generative Multimodal Models are In-Context Learnerscited by 446
  29. 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 423
  30. 2024Mixture-of-Agents Enhances Large Language Model Capabilitiescited by 420
  31. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  32. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 416
  33. 2024AFlow: Automating Agentic Workflow Generationcited by 395
  34. 2024OmniGen: Unified Image Generationcited by 388
  35. 2024Automated Design of Agentic Systemscited by 360
  36. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
  37. 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 290
  38. 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 268

50 most cited of 79 All 79 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026GenEvolve: Self-Evolving Image Generation Agents via Tool-Orchestrated Visual Experience Distillation
  2. 2026ManimAgent: Self-Evolving Multimodal Agents for Visual Education
  3. 2026V-Gym: Enhancing Agentic Visual Reasoning via Skill-Data Co-Evolution
  4. 2026GenMem: Generative Symbolic Memory for Self-Evolving Harness
  5. 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoning
  6. 2026Search Beyond What Can Be Taught: Evolving the Knowledge Boundary in Agentic Visual Generation
  7. 2023GENOME: GenerativE Neuro-symbOlic visual reasoning by growing and reusing ModulEs
  8. 2026RS-Gen: A Multi-Stage Agentic Framework for Reasoning and Search-Augmented Image Generation