SCMAPR: Self-Correcting Multi-Agent Prompt Refinement for Complex-Scenario Text-to-Video Generation
On the map: Diffusion models → Video generation
Abstract (arXiv)
Text-to-Video (T2V) generation has benefited from recent advances in diffusion models, yet current systems still struggle under complex scenarios, which are generally exacerbated by the ambiguity and underspecification of text prompts. In this work, we formulate complex-scenario prompt refinement as a stage-wise multi-agent refinement process and propose SCMAPR, i.e., a scenario-aware and Self-Correcting Multi-Agent Prompt Refinement framework for T2V prompting. SCMAPR coordinates specialized agents to (i) route each prompt to a taxonomy-grounded scenario for strategy selection, (ii) synthesize scenario-aware rewriting policies and perform policy-conditioned refinement, and (iii) conduct structured semantic verification that triggers conditional revision when violations are detected. To clarify what constitutes complex scenarios in T2V prompting, provide representative examples, and enable rigorous evaluation under such challenging conditions, we further introduce T2V-Complexity, which is a complex-scenario T2V benchmark consisting exclusively of complex-scenario prompts. Extensive experiments on 3 existing benchmarks and our T2V-Complexity benchmark demonstrate that SCMAPR consistently improves text-video alignment and overall generation quality under complex scenarios, achieving up to 2.67% and 3.28 gains in average score on VBench and EvalCrafter, and up to 0.028 improvement on T2V-CompBench over 3 State-Of-The-Art baselines. The codes of SCMAPR are publicly available at https://github.com/HiThink-Research/SCMAPR.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 27 of its 148 references that are in the map. First posted on arXiv 7 Apr 2026.
Builds on
27 of 148 references.
Closest ancestors · 6
Same direction, newest first
- 2025EIDT-V: Exploiting Intersections in Diffusion Trajectories for Model-Agnostic, Zero-Shot, Training-Free Text-to-Video Generation9 Apr
- 2025BlobGEN-Vid: Compositional Text-to-Video Generation with Blob Video Representations13 Jan
- 2024Re-Attentional Controllable Video Diffusion Editing16 Dec
- 2024LinGen: Towards High-Resolution Minute-Length Text-to-Video Generation with Linear Computational Complexity13 Dec
- 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generation30 Nov
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
Other references · 21
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 185
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
- 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
- 2022Investigating Prompt Engineering in Diffusion Modelscited by 58
- 2024GROOT: Generating Robust Watermark for Diffusion-Model-Based Audio Synthesiscited by 21
- 2025The Devil is in the Prompts: Retrieval-Augmented Prompt Optimization for Text-to-Video Generationcited by 21
- 2024InstanceCap: Improving Text-to-Video Generation via Instance-aware Structured Captioncited by 17
9 more
- 2023DiffProsody: Diffusion-based Latent Prosody Generation for Expressive Speech Synthesis with Prosody Conditional Adversarial Trainingcited by 16
- 2025Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generationcited by 14
- 2025Scene Splatter: Momentum 3D Scene Generation from Single Image with Video Diffusion Modelcited by 13
- 2025Nexus: An Omni-Perceptive And -Interactive Model for Language, Audio, And Visioncited by 12
- 2024Prompt Refinement with Image Pivot for Text-to-Image Generationcited by 11
- 2024CTRL-D: Controllable Dynamic 3D Scene Editing with Personalized 2D Diffusioncited by 11
- 2024ByTheWay: Boost Your Text-to-Video Generation Model to Higher Quality in a Training-free Waycited by 7
- 2025CARFT: Boosting LLM Reasoning via Contrastive Learning with Annotated Chain-of-Thought-based Reinforced Fine-Tuningcited by 4
- 2025SGDPO: Self-Guided Direct Preference Optimization for Language Model Alignmentcited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026When Cultures Move: Measuring and Improving Multicultural Text-to-Video Generationcited by 1
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
- 2026WanPE: Towards Cinematic Prompt Enhancement for Modern Text-to-Video Generationcited by 1
- 2026Towards Unified Evaluation of Prompt Enhancers for Video Generationcited by 0
- 2026Towards Unified Evaluation of Prompt Enhancers for Video Generation8 Oct 2026
- 2026WanPE: Towards Cinematic Prompt Enhancement for Modern Text-to-Video Generation24 Sep 2026
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026When Cultures Move: Measuring and Improving Multicultural Text-to-Video Generation16 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025GenPilot: A Multi-Agent System for Test-Time Prompt Optimization in Image Generation
- 2025RAPO++: Cross-Stage Prompt Optimization for Text-to-Video Generation via Data Alignment and Test-Time Scaling
- 2024Batch-Instructed Gradient for Prompt Evolution:Systematic Prompt Optimization for Enhanced Text-to-Image Synthesis
- 2025T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generation
- 2024GenMAC: Compositional Text-to-Video Generation with Multi-Agent Collaboration
- 2026Internalizing Agent Experience into Diffusion Model Weights via On-Policy Context Distillation
- 2026M3: High-fidelity Text-to-Image Generation via Multi-Modal, Multi-Agent and Multi-Round Visual Reasoning
- 2025PromptSculptor: Multi-Agent Based Text-to-Image Prompt Optimization