mlsanityData to 14 Oct 2026

SCMAPR: Self-Correcting Multi-Agent Prompt Refinement for Complex-Scenario Text-to-Video Generation

arXiv 2604.05489 ↗First posted 7 Apr 2026cs.AI cs.MAcited by 4

On the map: Diffusion models → Video generation

Abstract (arXiv)

Text-to-Video (T2V) generation has benefited from recent advances in diffusion models, yet current systems still struggle under complex scenarios, which are generally exacerbated by the ambiguity and underspecification of text prompts. In this work, we formulate complex-scenario prompt refinement as a stage-wise multi-agent refinement process and propose SCMAPR, i.e., a scenario-aware and Self-Correcting Multi-Agent Prompt Refinement framework for T2V prompting. SCMAPR coordinates specialized agents to (i) route each prompt to a taxonomy-grounded scenario for strategy selection, (ii) synthesize scenario-aware rewriting policies and perform policy-conditioned refinement, and (iii) conduct structured semantic verification that triggers conditional revision when violations are detected. To clarify what constitutes complex scenarios in T2V prompting, provide representative examples, and enable rigorous evaluation under such challenging conditions, we further introduce T2V-Complexity, which is a complex-scenario T2V benchmark consisting exclusively of complex-scenario prompts. Extensive experiments on 3 existing benchmarks and our T2V-Complexity benchmark demonstrate that SCMAPR consistently improves text-video alignment and overall generation quality under complex scenarios, achieving up to 2.67% and 3.28 gains in average score on VBench and EvalCrafter, and up to 0.028 improvement on T2V-CompBench over 3 State-Of-The-Art baselines. The codes of SCMAPR are publicly available at https://github.com/HiThink-Research/SCMAPR.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 27 of its 148 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

27 of 148 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025EIDT-V: Exploiting Intersections in Diffusion Trajectories for Model-Agnostic, Zero-Shot, Training-Free Text-to-Video Generation9 Apr
  2. 2025BlobGEN-Vid: Compositional Text-to-Video Generation with Blob Video Representations13 Jan
  3. 2024Re-Attentional Controllable Video Diffusion Editing16 Dec
  4. 2024LinGen: Towards High-Resolution Minute-Length Text-to-Video Generation with Linear Computational Complexity13 Dec
  5. 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generation30 Nov
  6. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug

Other references · 21

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  2. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  3. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  4. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
  5. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
  6. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 185
  7. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
  8. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
  9. 2022Investigating Prompt Engineering in Diffusion Modelscited by 58
  10. 2024GROOT: Generating Robust Watermark for Diffusion-Model-Based Audio Synthesiscited by 21
  11. 2025The Devil is in the Prompts: Retrieval-Augmented Prompt Optimization for Text-to-Video Generationcited by 21
  12. 2024InstanceCap: Improving Text-to-Video Generation via Instance-aware Structured Captioncited by 17
9 more
  1. 2023DiffProsody: Diffusion-based Latent Prosody Generation for Expressive Speech Synthesis with Prosody Conditional Adversarial Trainingcited by 16
  2. 2025Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generationcited by 14
  3. 2025Scene Splatter: Momentum 3D Scene Generation from Single Image with Video Diffusion Modelcited by 13
  4. 2025Nexus: An Omni-Perceptive And -Interactive Model for Language, Audio, And Visioncited by 12
  5. 2024Prompt Refinement with Image Pivot for Text-to-Image Generationcited by 11
  6. 2024CTRL-D: Controllable Dynamic 3D Scene Editing with Personalized 2D Diffusioncited by 11
  7. 2024ByTheWay: Boost Your Text-to-Video Generation Model to Higher Quality in a Training-free Waycited by 7
  8. 2025CARFT: Boosting LLM Reasoning via Contrastive Learning with Annotated Chain-of-Thought-based Reinforced Fine-Tuningcited by 4
  9. 2025SGDPO: Self-Guided Direct Preference Optimization for Language Model Alignmentcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025GenPilot: A Multi-Agent System for Test-Time Prompt Optimization in Image Generation
  2. 2025RAPO++: Cross-Stage Prompt Optimization for Text-to-Video Generation via Data Alignment and Test-Time Scaling
  3. 2024Batch-Instructed Gradient for Prompt Evolution:Systematic Prompt Optimization for Enhanced Text-to-Image Synthesis
  4. 2025T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generation
  5. 2024GenMAC: Compositional Text-to-Video Generation with Multi-Agent Collaboration
  6. 2026Internalizing Agent Experience into Diffusion Model Weights via On-Policy Context Distillation
  7. 2026M3: High-fidelity Text-to-Image Generation via Multi-Modal, Multi-Agent and Multi-Round Visual Reasoning
  8. 2025PromptSculptor: Multi-Agent Based Text-to-Image Prompt Optimization