mlsanityData to 7 Oct 2026

Code2Video: A Code-centric Paradigm for Educational Video Generation

arXiv 2510.01174 ↗First posted 1 Oct 2025cs.CV cs.AI cs.CLcited by 23

Not on the map. Why?

Abstract (arXiv)

While recent generative models advance pixel-space video synthesis, they remain limited in producing professional educational videos, which demand disciplinary knowledge, precise visual structures, and coherent transitions, limiting their applicability in educational scenarios. Intuitively, such requirements are better addressed through the manipulation of a renderable environment, which can be explicitly controlled via logical commands (e.g., code). In this work, we propose Code2Video, a code-centric agent framework for generating educational videos via executable Python code. The framework comprises three collaborative agents: (i) Planner, which structures lecture content into temporally coherent flows and prepares corresponding visual assets; (ii) Coder, which converts structured instructions into executable Python codes while incorporating scope-guided auto-fix to enhance efficiency; and (iii) Critic, which leverages vision-language models (VLM) with visual anchor prompts to refine spatial layout and ensure clarity. To support systematic evaluation, we build MMMC, a benchmark of professionally produced, discipline-specific educational videos. We evaluate MMMC across diverse dimensions, including VLM-as-a-Judge aesthetic scores, code efficiency, and particularly, TeachQuiz, a novel end-to-end metric that quantifies how well a VLM, after unlearning, can recover knowledge by watching the generated videos. Our results demonstrate the potential of Code2Video as a scalable, interpretable, and controllable approach, achieving 40% improvement over direct code generation and producing videos comparable to human-crafted tutorials. The code and datasets are available at https://github.com/showlab/Code2Video.

Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 42 of its 53 references that are in the map. First posted on arXiv 1 Oct 2025.

Builds on

42 of 53 references.

References · 42

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  3. 2022Video Diffusion Modelscited by 2,280
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  5. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  6. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  7. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  8. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  9. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Modelscited by 297
  10. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
  11. 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 226
  12. 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 157
30 more
  1. 2023Make-Your-Video: Customized Video Generation Using Textual and Structural Guidancecited by 129
  2. 2025Long-Context Autoregressive Video Modeling with Next-Frame Predictioncited by 119
  3. 2024Loong: Generating Minute-level Long Videos with Autoregressive Language Modelscited by 99
  4. 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 88
  5. 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attentioncited by 87
  6. 2023ARTboldsymbol·V: Auto-Regressive Text-to-Video Generation with Diffusion Modelscited by 74
  7. 2024A Review of Prominent Paradigms for LLM-Based Agents: Tool Use (Including RAG), Planning, and Feedback Learningcited by 74
  8. 2024Progressive Autoregressive Video Diffusion Modelscited by 65
  9. 2025Paper2Poster: Towards Multimodal Poster Automation from Scientific Paperscited by 56
  10. 2024Mora: Enabling Generalist Video Generation via A Multi-Agent Frameworkcited by 41
  11. 2024ARLON: Boosting Diffusion Transformers with Autoregressive Models for Long Video Generationcited by 41
  12. 2025How to Enable LLM with 3D Capacity? A Survey of Spatial Reasoning in LLMcited by 41
  13. 2024A Survey on Long Video Generation: Challenges, Methods, and Prospectscited by 40
  14. 2024DreamFactory: Pioneering Multi-Scene Long Video Generation with a Multi-Agent Frameworkcited by 31
  15. 2024From Words to Structured Visuals: A Benchmark and Framework for Text-to-Diagram Generation and Editingcited by 29
  16. 2024StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaborationcited by 28
  17. 2025ProjectEval: A Benchmark for Programming Agents Automated Evaluation on Project-Level Code Generationcited by 26
  18. 2025Position: Agent Should Invoke External Tools ONLY When Epistemically Necessarycited by 22
  19. 2025Lumos-1: On Autoregressive Video Generation with Discrete Diffusion from a Unified Model Perspectivecited by 22
  20. 2025TheoremExplainAgent: Towards Video-based Multimodal Explanations for LLM Theorem Understandingcited by 20
  21. 2024VipAct: Visual-Perception Enhancement via Specialized VLM Agent Collaboration and Tool-usecited by 17
  22. 2024From Data to Story: Towards Automatic Animated Data Video Creation with LLM-based Multi-Agent Systemscited by 16
  23. 2024GenMAC: Compositional Text-to-Video Generation with Multi-Agent Collaborationcited by 15
  24. 2024GenRec: Unifying Video Generation and Recognition with Diffusion Modelscited by 11
  25. 2024CodeNav: Beyond tool-use to using real-world codebases with LLM agentscited by 8
  26. 2025Code Shaping: Iterative Code Editing with Free-form AI-Interpreted Sketchingcited by 7
  27. 2025Manimator: Transforming Research Papers into Visual Explanationscited by 5
  28. 2024Program Synthesis Benchmark for Visual Programming in XLogoOnline Environmentcited by 4
  29. 2025MoGraphGPT: Creating Interactive Scenes Using Modular LLM and Graphical Controlcited by 3
  30. 2025UniAPO: Unified Multimodal Automated Prompt Optimizationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 22.

23 papers.

Sort:

By area:

  1. 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 10
  2. 2026Beyond End-to-End Video Models: An LLM-Based Multi-Agent System for Educational Video Generationcited by 4
  3. 2026IMAGAgent: Orchestrating Multi-Turn Image Editing via Constraint-Aware Planning and Reflectioncited by 4
  4. 2026ManiBench: A Benchmark for Testing Visual-Logic Drift and Syntactic Hallucinations in Manim Code Generationcited by 2
  5. 2026How Far Are Vision-Language Models from Constructing the Real World? A Benchmark for Physical Generative Reasoningcited by 2
  6. 2026ViviDoc: Generating Interactive Documents through Human-Agent Collaborationcited by 2
  7. 2026Training and Agentic Inference Strategies for LLM-based Manim Animation Generationcited by 2
  8. 2025TeachMaster: Generative Teaching via Codecited by 1
  9. 2026EduIllustrate: Towards Scalable Automated Generation Of Multimodal Educational Contentcited by 1
  10. 2026EvoDiagram: Agentic Editable Diagram Creation via Design Expertise Evolutioncited by 1
  11. 2026ANVIL: Analogies and Videos for Lecturerscited by 1
  12. 2026PRISM: A Benchmark for Programmatic Spatial-Temporal Reasoningcited by 1
11 more
  1. 2026Supervise What Survives: Geometry-Guided VLA Adaptation from Synthetic Robot Videoscited by 1
  2. 2026ManimAgent: Self-Evolving Multimodal Agents for Visual Educationcited by 1
  3. 2026Demonstrating ViviDoc: Generating Interactive Documents through Human-Agent Collaborationcited by 0
  4. 2026ALGOGEN: Tool-Generated Verifiable Traces for Reliable Algorithm Visualizationcited by 0
  5. 2026See Before You Code: Learning Visual Priors for Spatially Aware Educational Animation Generationcited by 0
  6. 2026Helping Figures Tell their Story! Paper-Grounded Video Generation Explaining Complex Scientific Figurescited by 0
  7. 2026SGA: Plug&Play Geometric Verification for Educational Video Synthesiscited by 0
  8. 2026EduPanel: A Three-Agent LLM Judge for Teaching Videos -- Reliability, Complementarity, and Human Trust Calibrationcited by 0
  9. 2026Findings of the First Teaching Monster Challenge: A Benchmark of Pedagogical Content Knowledge in AI Agentscited by 0
  10. 2026From Content Generation to Learning Support: Pedagogy-Guided Generative Video Tutors for STEM Learningcited by 0
  11. 2026RULER: Instance-aware Rubric Rewards for SVG Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine System
  2. 2026VideoWeaver: Evaluating and Evolving Skills for Agentic Long Video Generation
  3. 2025VISTA: A Test-Time Self-Improving Video Generation Agent
  4. 2025Stealing Creator's Workflow: A Creator-Inspired Agentic Framework with Iterative Feedback Loop for Improved Scientific Short-form Generation
  5. 2026TemplateCraft: Agentic Visual Template Generation
  6. 2026Animation2Code: Evaluating Temporal Visual Reasoning in Video-to-Code Generation
  7. 2025MoReGen: Multi-Agent Motion-Reasoning Engine for Code-based Text-to-Video Synthesis
  8. 2026GenClaw: Code-Driven Agentic Image Generation