ManimAgent: Self-Evolving Multimodal Agents for Visual Education
On the map: LLM agents and tool use → Multimodal and embodied agents
also in 1 more
Abstract (arXiv)
Multi-round reflection lets agents built on large language models recover from failures within a single task, but each task remains an isolated episode: lessons learned across many reflection rounds on one task are discarded before the next begins. We study this gap on a code-generation task: from a scientific paper section, the agent writes Python in the open-source Manim library to render a mathematical animation. We present ManimAgent, a self-evolving multimodal agent that carries reflection experience across tasks through a dual-channel Episodic Memory Bank grown entirely from its own task stream, with no weight updates and no human seeds. After each animation converges, a vision-language model scores the rendered keyframes; the resulting signals populate a positive channel M+ that stores success rationales as soft Reference Examples, and a negative channel M- that stores validated failure patterns as hard Known Pitfalls. On a fixed-probe evaluation against no-memory, matched-budget retrieval-augmented generation, and shuffled-memory baselines, blind human Pass@1 rises and reflection rounds fall as memory size grows. We will release the code, frozen memory snapshots, and the task stream.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 20 of its 29 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
20 of 29 references.
Closest ancestors · 1
Same direction, newest first
Other references · 19
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
7 more
- 2023RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generationcited by 357
- 2022DocPrompting: Generating Code by Retrieving the Docscited by 151
- 2024Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluationcited by 123
- 2025Code2Video: A Code-centric Paradigm for Educational Video Generationcited by 23
- 2025Paper2Video: Automatic Video Generation from Scientific Paperscited by 23
- 2025Manimator: Transforming Research Papers into Visual Explanationscited by 5
- 2026LLM2Manim: Pedagogy-Aware AI Generation of STEM Animationscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026GenEvolve: Self-Evolving Image Generation Agents via Tool-Orchestrated Visual Experience Distillation
- 2026OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learning
- 2026VISA: Agentic Self-Evolving Data Synthesis for Multimodal Instruction Following
- 2025Agent0-VL: Exploring Self-Evolving Agent for Tool-Integrated Vision-Language Reasoning
- 2026V-Gym: Enhancing Agentic Visual Reasoning via Skill-Data Co-Evolution
- 2026MMSkills: Towards Multimodal Skills for General Visual Agents
- 2026VisualClaw: A Real-Time, Personalized Agent for the Physical World
- 2025Evolutionary Prompt Optimization Discovers Emergent Multimodal Reasoning Strategies in Vision-Language Models