mlsanityData to 14 Oct 2026

SkillPE: Creativity-Oriented Cinematic Skill Evolution for Text-to-Video Prompt Engineering

arXiv 2609.34335 ↗First posted 28 Sep 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Achieving high-quality, cinematic results in text-to-video generation remains challenging for non-experts, whose prompts often lack professional narrative and creative design. We propose SkillPE, a prompt engineering (PE) framework that evolves reusable cinematic skills from expert-authored seeds. SkillPE represents shot logic, composition, lighting, sound design, and other filmmaking cues in a fine-grained format, and retrieves movie references categorized as resonators (good matches), dissonants (weak matches), and divergents (creatively useful near-misses). The first two refine when and how a skill should be applied, while divergents inspire alternative cinematic realizations at different degrees of modification while preserving the user intent. Candidate skills are assessed through generated videos along prompt fidelity, cinematic quality, narrative appeal, and creativity to construct the final skill libraries. Experiments on StoryEval and VBench show improvements of up to 1.40 points over the strongest external baseline and 0.51 points over seed skills on 7-point four-dimensional evaluation, while remaining competitive on benchmark-native metrics. Overall, SkillPE offers a practical approach to balancing fidelity and creativity in cinematic text-to-video generation. Code is available at https://github.com/Ais0n/SkillPE .

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 48 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

23 of 48 references.

References · 23

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  3. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  4. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
  5. 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 192
  6. 2016Movie Descriptioncited by 181
  7. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
  8. 2025Reinforcement Learning for Self-Improving Agent with Skill Librarycited by 100
  9. 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 89
  10. 2025T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generationcited by 33
  11. 2025VISTA: A Test-Time Self-Improving Video Generation Agentcited by 31
  12. 2024Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generationcited by 30
11 more
  1. 2025VPO: Aligning Text-to-Video Generation Models with Prompt Optimizationcited by 30
  2. 2023Movie101: A New Movie Understanding Benchmarkcited by 25
  3. 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoningcited by 24
  4. 2026Mind-Brush: Integrating Agentic Cognitive Search and Reasoning into Image Generationcited by 23
  5. 2025The Devil is in the Prompts: Retrieval-Augmented Prompt Optimization for Text-to-Video Generationcited by 21
  6. 2025MAViS: A Multi-Agent Framework for Long-Sequence Video Storytellingcited by 21
  7. 2026GenEvolve: Self-Evolving Image Generation Agents via Tool-Orchestrated Visual Experience Distillationcited by 19
  8. 2026VQQA: An Agentic Approach for Video Evaluation and Quality Improvementcited by 12
  9. 2026NEWTON: Agentic Planning for Physically Grounded Video Generationcited by 12
  10. 2025V-Stylist: Video Stylization via Collaboration and Reflection of MLLM Agentscited by 9
  11. 2026VideoAgent: All-in-One Framework for Video Understanding and Editingcited by 6

Built on by

Not cited yet.