Reels-RSI: Program-Level Self-Improvement for Code-Rendered Explainer Videos
Not on the map. Why?
Abstract (arXiv)
Explainer videos -- a worked geometry problem, why the sky is blue, how a dynasty fell -- are usually one more target for pixel video generation. We argue they are a different kind of artifact: a program (script, storyboard and per-frame animation code) that a deterministic renderer turns into frames. A program can be read, diffed, tested and audited; pixels can only be watched. Reels-RSI is an open-source reel director for any agent harness; its self-improvement happens at the program level rather than in weights or prompts. Every revision pass is logged with a code snapshot; a retrospective pairs each check finding with the diff that fixed it and proposes lessons; a lesson that a static check can catch is compiled into a rule with a must-fail and a must-pass example, so the memory is unit-tested; and a rule learned today runs over everything made before it. A bounded, benchmark-gated step lets an agent rewrite the director's playbook, kept only when blind pairwise judgments on held-out topics prefer it; nothing enters memory without a human decision. Across 111 reels -- a field study, two playbook evolutions, a 2x2 memory ablation, a weaker director, a 48-reel learning curve and a judge-reliability study -- we find that the rule learned in the field caught four latent defects in frames authored before it existed and none after; that rules are an audit for a strong director (eight unguarded reels, no violation) and a guard for a weaker one (thirty violations unguarded versus five); that lessons shorten revision loops but do not compound or move the judge; and that the first rewrite's 11--1 verdict was a position bias in our vote design (judges pick the second-shown reel 62--81% of the time), masking scripts that traded thirteen facts for craft. We document four failure modes of the preference signal, which check caught each, and the fixes. Code, rules, lessons and data are public.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 24 references that are in the map. First posted on arXiv 10 Oct 2026.
Builds on
23 of 24 references.
References · 23
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
- 2024Automated Design of Agentic Systemscited by 407
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
- 2025Inducing Programmatic Skills for Agentic Taskscited by 111
- 2026SkillRevise: Improving LLM-Authored Agent Skills via Trace-Conditioned Skill Revisioncited by 30
- 2025Code2Video: A Code-centric Paradigm for Educational Video Generationcited by 27
11 more
- 2025TheoremExplainAgent: Towards Video-based Multimodal Explanations for LLM Theorem Understandingcited by 24
- 2025KNighter: Transforming Static Analysis with LLM-Synthesized Checkerscited by 24
- 2026More Convincing, Not More Correct: Self-Play Reward Hacking of Reference-Free LLM Judgescited by 10
- 2026VideoWeaver: Evaluating and Evolving Skills for Agentic Long Video Generationcited by 7
- 2026On the Fragility of Self-Improving Agents: Variance, Task Order, and Underspecificationcited by 4
- 2026LLM-as-a-Judge Is Not an Oracle: Why Self-Improving Agents Need Deterministic Guardrailscited by 3
- 2024Write Your Own CodeChecker: An Automated Test-Driven Checker Development Approach with LLMscited by 2
- 2026Aligning Progress and Feasibility: A Neuro-Symbolic Dual Memory Framework for Long-Horizon LLM Agentscited by 2
- 2026ManimAgent: Self-Evolving Multimodal Agents for Visual Educationcited by 2
- 2026Findings of the First Teaching Monster Challenge: A Benchmark of Pedagogical Content Knowledge in AI Agentscited by 1
- 2026CineForge: Self-Improving Agents for Long-Horizon Video Generationcited by 1
Built on by
Not cited yet.