Code2Video: A Code-centric Paradigm for Educational Video Generation
Not on the map. Why?
Abstract (arXiv)
While recent generative models advance pixel-space video synthesis, they remain limited in producing professional educational videos, which demand disciplinary knowledge, precise visual structures, and coherent transitions, limiting their applicability in educational scenarios. Intuitively, such requirements are better addressed through the manipulation of a renderable environment, which can be explicitly controlled via logical commands (e.g., code). In this work, we propose Code2Video, a code-centric agent framework for generating educational videos via executable Python code. The framework comprises three collaborative agents: (i) Planner, which structures lecture content into temporally coherent flows and prepares corresponding visual assets; (ii) Coder, which converts structured instructions into executable Python codes while incorporating scope-guided auto-fix to enhance efficiency; and (iii) Critic, which leverages vision-language models (VLM) with visual anchor prompts to refine spatial layout and ensure clarity. To support systematic evaluation, we build MMMC, a benchmark of professionally produced, discipline-specific educational videos. We evaluate MMMC across diverse dimensions, including VLM-as-a-Judge aesthetic scores, code efficiency, and particularly, TeachQuiz, a novel end-to-end metric that quantifies how well a VLM, after unlearning, can recover knowledge by watching the generated videos. Our results demonstrate the potential of Code2Video as a scalable, interpretable, and controllable approach, achieving 40% improvement over direct code generation and producing videos comparable to human-crafted tutorials. The code and datasets are available at https://github.com/showlab/Code2Video.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 42 of its 53 references that are in the map. First posted on arXiv 1 Oct 2025.
Builds on
42 of 53 references.
References · 42
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2022Video Diffusion Modelscited by 2,280
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Modelscited by 297
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
- 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 226
- 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 157
30 more
- 2023Make-Your-Video: Customized Video Generation Using Textual and Structural Guidancecited by 129
- 2025Long-Context Autoregressive Video Modeling with Next-Frame Predictioncited by 119
- 2024Loong: Generating Minute-level Long Videos with Autoregressive Language Modelscited by 99
- 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 88
- 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attentioncited by 87
- 2023ARTboldsymbol·V: Auto-Regressive Text-to-Video Generation with Diffusion Modelscited by 74
- 2024A Review of Prominent Paradigms for LLM-Based Agents: Tool Use (Including RAG), Planning, and Feedback Learningcited by 74
- 2024Progressive Autoregressive Video Diffusion Modelscited by 65
- 2025Paper2Poster: Towards Multimodal Poster Automation from Scientific Paperscited by 56
- 2024Mora: Enabling Generalist Video Generation via A Multi-Agent Frameworkcited by 41
- 2024ARLON: Boosting Diffusion Transformers with Autoregressive Models for Long Video Generationcited by 41
- 2025How to Enable LLM with 3D Capacity? A Survey of Spatial Reasoning in LLMcited by 41
- 2024A Survey on Long Video Generation: Challenges, Methods, and Prospectscited by 40
- 2024DreamFactory: Pioneering Multi-Scene Long Video Generation with a Multi-Agent Frameworkcited by 31
- 2024From Words to Structured Visuals: A Benchmark and Framework for Text-to-Diagram Generation and Editingcited by 29
- 2024StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaborationcited by 28
- 2025ProjectEval: A Benchmark for Programming Agents Automated Evaluation on Project-Level Code Generationcited by 26
- 2025Position: Agent Should Invoke External Tools ONLY When Epistemically Necessarycited by 22
- 2025Lumos-1: On Autoregressive Video Generation with Discrete Diffusion from a Unified Model Perspectivecited by 22
- 2025TheoremExplainAgent: Towards Video-based Multimodal Explanations for LLM Theorem Understandingcited by 20
- 2024VipAct: Visual-Perception Enhancement via Specialized VLM Agent Collaboration and Tool-usecited by 17
- 2024From Data to Story: Towards Automatic Animated Data Video Creation with LLM-based Multi-Agent Systemscited by 16
- 2024GenMAC: Compositional Text-to-Video Generation with Multi-Agent Collaborationcited by 15
- 2024GenRec: Unifying Video Generation and Recognition with Diffusion Modelscited by 11
- 2024CodeNav: Beyond tool-use to using real-world codebases with LLM agentscited by 8
- 2025Code Shaping: Iterative Code Editing with Free-form AI-Interpreted Sketchingcited by 7
- 2025Manimator: Transforming Research Papers into Visual Explanationscited by 5
- 2024Program Synthesis Benchmark for Visual Programming in XLogoOnline Environmentcited by 4
- 2025MoGraphGPT: Creating Interactive Scenes Using Modular LLM and Graphical Controlcited by 3
- 2025UniAPO: Unified Multimodal Automated Prompt Optimizationcited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 22.
23 papers.
Sort:
By area:
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 10
- 2026Beyond End-to-End Video Models: An LLM-Based Multi-Agent System for Educational Video Generationcited by 4
- 2026IMAGAgent: Orchestrating Multi-Turn Image Editing via Constraint-Aware Planning and Reflectioncited by 4
- 2026ManiBench: A Benchmark for Testing Visual-Logic Drift and Syntactic Hallucinations in Manim Code Generationcited by 2
- 2026How Far Are Vision-Language Models from Constructing the Real World? A Benchmark for Physical Generative Reasoningcited by 2
- 2026ViviDoc: Generating Interactive Documents through Human-Agent Collaborationcited by 2
- 2026Training and Agentic Inference Strategies for LLM-based Manim Animation Generationcited by 2
- 2025TeachMaster: Generative Teaching via Codecited by 1
- 2026EduIllustrate: Towards Scalable Automated Generation Of Multimodal Educational Contentcited by 1
- 2026EvoDiagram: Agentic Editable Diagram Creation via Design Expertise Evolutioncited by 1
- 2026ANVIL: Analogies and Videos for Lecturerscited by 1
- 2026PRISM: A Benchmark for Programmatic Spatial-Temporal Reasoningcited by 1
11 more
- 2026Supervise What Survives: Geometry-Guided VLA Adaptation from Synthetic Robot Videoscited by 1
- 2026ManimAgent: Self-Evolving Multimodal Agents for Visual Educationcited by 1
- 2026Demonstrating ViviDoc: Generating Interactive Documents through Human-Agent Collaborationcited by 0
- 2026ALGOGEN: Tool-Generated Verifiable Traces for Reliable Algorithm Visualizationcited by 0
- 2026See Before You Code: Learning Visual Priors for Spatially Aware Educational Animation Generationcited by 0
- 2026Helping Figures Tell their Story! Paper-Grounded Video Generation Explaining Complex Scientific Figurescited by 0
- 2026SGA: Plug&Play Geometric Verification for Educational Video Synthesiscited by 0
- 2026EduPanel: A Three-Agent LLM Judge for Teaching Videos -- Reliability, Complementarity, and Human Trust Calibrationcited by 0
- 2026Findings of the First Teaching Monster Challenge: A Benchmark of Pedagogical Content Knowledge in AI Agentscited by 0
- 2026From Content Generation to Learning Support: Pedagogy-Guided Generative Video Tutors for STEM Learningcited by 0
- 2026RULER: Instance-aware Rubric Rewards for SVG Generationcited by 0
- 2026RULER: Instance-aware Rubric Rewards for SVG Generation21 Sep 2026
- 2026From Content Generation to Learning Support: Pedagogy-Guided Generative Video Tutors for STEM Learning21 Sep 2026
- 2026Findings of the First Teaching Monster Challenge: A Benchmark of Pedagogical Content Knowledge in AI Agents9 Aug 2026
- 2026EduPanel: A Three-Agent LLM Judge for Teaching Videos -- Reliability, Complementarity, and Human Trust Calibration20 Jul 2026
- 2026SGA: Plug&Play Geometric Verification for Educational Video Synthesis20 Jul 2026
- 2026ManimAgent: Self-Evolving Multimodal Agents for Visual Education29 Jun 2026
- 2026Supervise What Survives: Geometry-Guided VLA Adaptation from Synthetic Robot Videos23 Jun 2026
- 2026Helping Figures Tell their Story! Paper-Grounded Video Generation Explaining Complex Scientific Figures10 Jun 2026
- 2026PRISM: A Benchmark for Programmatic Spatial-Temporal Reasoning19 May 2026
- 2026See Before You Code: Learning Visual Priors for Spatially Aware Educational Animation Generation15 May 2026
- 2026ALGOGEN: Tool-Generated Verifiable Traces for Reliable Algorithm Visualization12 May 2026
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond24 Apr 2026
11 more
- 2026Training and Agentic Inference Strategies for LLM-based Manim Animation Generation20 Apr 2026
- 2026ANVIL: Analogies and Videos for Lecturers15 Apr 2026
- 2026EduIllustrate: Towards Scalable Automated Generation Of Multimodal Educational Content6 Apr 2026
- 2026ViviDoc: Generating Interactive Documents through Human-Agent Collaboration30 Mar 2026
- 2026How Far Are Vision-Language Models from Constructing the Real World? A Benchmark for Physical Generative Reasoning25 Mar 2026
- 2026Demonstrating ViviDoc: Generating Interactive Documents through Human-Agent Collaboration2 Mar 2026
- 2026ManiBench: A Benchmark for Testing Visual-Logic Drift and Syntactic Hallucinations in Manim Code Generation24 Feb 2026
- 2026EvoDiagram: Agentic Editable Diagram Creation via Design Expertise Evolution20 Feb 2026
- 2026IMAGAgent: Orchestrating Multi-Turn Image Editing via Constraint-Aware Planning and Reflection12 Feb 2026
- 2026Beyond End-to-End Video Models: An LLM-Based Multi-Agent System for Educational Video Generation12 Feb 2026
- 2025TeachMaster: Generative Teaching via Code7 Dec 2025
- 2026Beyond End-to-End Video Models: An LLM-Based Multi-Agent System for Educational Video Generationcited by 4
- 2026ViviDoc: Generating Interactive Documents through Human-Agent Collaborationcited by 2
- 2026EvoDiagram: Agentic Editable Diagram Creation via Design Expertise Evolutioncited by 1
- 2026ManimAgent: Self-Evolving Multimodal Agents for Visual Educationcited by 1
- 2026Demonstrating ViviDoc: Generating Interactive Documents through Human-Agent Collaborationcited by 0
- 2026EduPanel: A Three-Agent LLM Judge for Teaching Videos -- Reliability, Complementarity, and Human Trust Calibrationcited by 0
- 2026Findings of the First Teaching Monster Challenge: A Benchmark of Pedagogical Content Knowledge in AI Agentscited by 0
- 2026Findings of the First Teaching Monster Challenge: A Benchmark of Pedagogical Content Knowledge in AI Agents9 Aug 2026
- 2026EduPanel: A Three-Agent LLM Judge for Teaching Videos -- Reliability, Complementarity, and Human Trust Calibration20 Jul 2026
- 2026ManimAgent: Self-Evolving Multimodal Agents for Visual Education29 Jun 2026
- 2026ViviDoc: Generating Interactive Documents through Human-Agent Collaboration30 Mar 2026
- 2026Demonstrating ViviDoc: Generating Interactive Documents through Human-Agent Collaboration2 Mar 2026
- 2026EvoDiagram: Agentic Editable Diagram Creation via Design Expertise Evolution20 Feb 2026
- 2026Beyond End-to-End Video Models: An LLM-Based Multi-Agent System for Educational Video Generation12 Feb 2026
- 2026How Far Are Vision-Language Models from Constructing the Real World? A Benchmark for Physical Generative Reasoningcited by 2
- 2026Training and Agentic Inference Strategies for LLM-based Manim Animation Generationcited by 2
- 2026PRISM: A Benchmark for Programmatic Spatial-Temporal Reasoningcited by 1
- 2026PRISM: A Benchmark for Programmatic Spatial-Temporal Reasoning19 May 2026
- 2026Training and Agentic Inference Strategies for LLM-based Manim Animation Generation20 Apr 2026
- 2026How Far Are Vision-Language Models from Constructing the Real World? A Benchmark for Physical Generative Reasoning25 Mar 2026
- 2026RULER: Instance-aware Rubric Rewards for SVG Generationcited by 0
- 2026RULER: Instance-aware Rubric Rewards for SVG Generation21 Sep 2026
- 2026IMAGAgent: Orchestrating Multi-Turn Image Editing via Constraint-Aware Planning and Reflectioncited by 4
- 2026ManiBench: A Benchmark for Testing Visual-Logic Drift and Syntactic Hallucinations in Manim Code Generationcited by 2
- 2025TeachMaster: Generative Teaching via Codecited by 1
- 2026EduIllustrate: Towards Scalable Automated Generation Of Multimodal Educational Contentcited by 1
- 2026ANVIL: Analogies and Videos for Lecturerscited by 1
- 2026ALGOGEN: Tool-Generated Verifiable Traces for Reliable Algorithm Visualizationcited by 0
- 2026See Before You Code: Learning Visual Priors for Spatially Aware Educational Animation Generationcited by 0
- 2026Helping Figures Tell their Story! Paper-Grounded Video Generation Explaining Complex Scientific Figurescited by 0
- 2026SGA: Plug&Play Geometric Verification for Educational Video Synthesiscited by 0
- 2026From Content Generation to Learning Support: Pedagogy-Guided Generative Video Tutors for STEM Learningcited by 0
- 2026From Content Generation to Learning Support: Pedagogy-Guided Generative Video Tutors for STEM Learning21 Sep 2026
- 2026SGA: Plug&Play Geometric Verification for Educational Video Synthesis20 Jul 2026
- 2026Helping Figures Tell their Story! Paper-Grounded Video Generation Explaining Complex Scientific Figures10 Jun 2026
- 2026See Before You Code: Learning Visual Priors for Spatially Aware Educational Animation Generation15 May 2026
- 2026ALGOGEN: Tool-Generated Verifiable Traces for Reliable Algorithm Visualization12 May 2026
- 2026ANVIL: Analogies and Videos for Lecturers15 Apr 2026
- 2026EduIllustrate: Towards Scalable Automated Generation Of Multimodal Educational Content6 Apr 2026
- 2026ManiBench: A Benchmark for Testing Visual-Logic Drift and Syntactic Hallucinations in Manim Code Generation24 Feb 2026
- 2026IMAGAgent: Orchestrating Multi-Turn Image Editing via Constraint-Aware Planning and Reflection12 Feb 2026
- 2025TeachMaster: Generative Teaching via Code7 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2026VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine System
- 2026VideoWeaver: Evaluating and Evolving Skills for Agentic Long Video Generation
- 2025VISTA: A Test-Time Self-Improving Video Generation Agent
- 2025Stealing Creator's Workflow: A Creator-Inspired Agentic Framework with Iterative Feedback Loop for Improved Scientific Short-form Generation
- 2026TemplateCraft: Agentic Visual Template Generation
- 2026Animation2Code: Evaluating Temporal Visual Reasoning in Video-to-Code Generation
- 2025MoReGen: Multi-Agent Motion-Reasoning Engine for Code-based Text-to-Video Synthesis
- 2026GenClaw: Code-Driven Agentic Image Generation