mlsanityData to 14 Oct 2026

SAGE: Self-Evolving Storyboard Skills via Attribution-Guided Rule Evolution

arXiv 2608.17468 ↗First posted 18 Aug 2026cs.AIcited by 0

On the map: Synthetic data and self-improvement for LLMs → Self-evolving LLM agents

Abstract (arXiv)

Storyboards turn screenplays into visual shot plans for automated short drama production. Professional storyboarding relies on tacit directorial expertise and remains an industrial bottleneck. Large language models can automate this step, but methods for supplying directing knowledge face three challenges: (1) Knowledge acquisition: the craft remains implicit in exemplars or must be written manually. (2) Knowledge refinement: authored knowledge is not evaluated against execution outcomes, and opaque generation prevents feedback attribution to the knowledge behind each decision. (3) Knowledge injection: injecting all knowledge exceeds usable context, while manual selection for every narrative group does not scale. We present SAGE (Skill with Attribution-Guided Evolution), a deployed framework that learns, attributes, evolves, and routes directing knowledge from expert demonstrations. SAGE derives rules that are independent of episode content by contrasting each training screenplay with its expert storyboard. During generation, the model records each narrative group's adopted rules. Combining these records with localized feedback enables targeted updates to individual rules. Evolved rules form scenario packages with a routing index, so each group retrieves only a bounded set appropriate to its situation without expert intervention. On 18 test episodes across three genres, SAGE scored 77.8 on a rubric validated by experts, versus 77.1 for professional directors. Deployed for 14 days on Virtual Film Studio, SAGE produced 1,344 narrative group outputs; 87.2 percent were accepted without substantive edits, and the production team recorded over 83 percent less authoring time per episode. We release PROSE, the first public dataset pairing screenplays with storyboards by professional directors across 68 episodes: https://github.com/creDreams/PROSE.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Self-evolving LLM agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 29 of its 73 references that are in the map. First posted on arXiv 18 Aug 2026.

Builds on

29 of 73 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025AgentEvolver: Towards Efficient Self-Evolving Agent System13 Nov

Other references · 28

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  4. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  5. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  6. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
  7. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,135
  8. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
  9. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
  10. 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
  11. 2021Learning To Retrieve Prompts for In-Context Learningcited by 648
  12. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 634
16 more
  1. 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 192
  2. 2024Cradle: Empowering Foundation Agents Towards General Computer Controlcited by 117
  3. 2023CLIN: A Continually Learning Language Agent for Rapid Task Adaptation and Generalizationcited by 95
  4. 2024Agent-Pro: Learning to Evolve via Policy-Level Reflection and Optimizationcited by 94
  5. 2024Trace is the Next AutoDiff: Generative Optimization with Rich Feedback, Execution Traces, and LLMscited by 69
  6. 2024Offline Training of Language Model Agents with Functions as Learnable Weightscited by 48
  7. 2023Failures Pave the Way: Enhancing Large Language Models through Tuning-free Rule Accumulationcited by 30
  8. 2025FilMaster: Bridging Cinematic Principles and Generative AI for Automated Film Generationcited by 28
  9. 2025CineTechBench: A Benchmark for Cinematographic Technique Understanding and Generationcited by 23
  10. 2023Dynamic Storyboard Generation in an Engine-based Virtual Environment for Video Productioncited by 21
  11. 2025Story2Board: A Training-Free Approach for Expressive Storyboard Generationcited by 17
  12. 2024Learning Long-form Video Prior via Generative Pre-Trainingcited by 8
  13. 2025CineVision: An Interactive Pre-visualization Storyboard System for Director-Cinematographer Collaborationcited by 7
  14. 2024SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Dramacited by 5
  15. 2026Audience in the Loop: Viewer Feedback-Driven Content Creation in Micro-drama Production on Social Mediacited by 2
  16. 2026DramaDirector: Geometry-Guided Short Drama Generationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026STAGE: A Full-Screenplay Benchmark for Reasoning over Evolving Stories
  2. 2025Bridging Your Imagination with Audio-Video Generation via a Unified Director
  3. 2026Co-Director: Agentic Generative Video Storytelling
  4. 2026CineForge: Self-Improving Agents for Long-Horizon Video Generation
  5. 2026CreativeInstruct: Scalably Teaching LLMs to Balance Quality, Creativity, and Diversity
  6. 2025Prompt-Driven Agentic Video Editing System: Autonomous Comprehension of Long-Form, Story-Driven Media
  7. 2026Camera Artist: A Multi-Agent Framework for Cinematic Language Storytelling Video Generation
  8. 2026SkillSpec: Consensus-Gated Agent Skill Evolution via Representation Specialization