mlsanityData to 14 Oct 2026

RAPO++: Cross-Stage Prompt Optimization for Text-to-Video Generation via Data Alignment and Test-Time Scaling

arXiv 2510.20206 ↗First posted 23 Oct 2025cs.CVcited by 10

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Prompt design plays a crucial role in text-to-video (T2V) generation, yet user-provided prompts are often short, unstructured, and misaligned with training data, limiting the generative potential of diffusion-based T2V models. We present RAPO++, a cross-stage prompt optimization framework that unifies training-data--aligned refinement, test-time iterative scaling, and large language model (LLM) fine-tuning to substantially improve T2V generation without modifying the underlying generative backbone. In Stage 1, Retrieval-Augmented Prompt Optimization (RAPO) enriches user prompts with semantically relevant modifiers retrieved from a relation graph and refactors them to match training distributions, enhancing compositionality and multi-object fidelity. Stage 2 introduces Sample-Specific Prompt Optimization (SSPO), a closed-loop mechanism that iteratively refines prompts using multi-source feedback -- including semantic alignment, spatial fidelity, temporal coherence, and task-specific signals such as optical flow -- yielding progressively improved video generation quality. Stage 3 leverages optimized prompt pairs from SSPO to fine-tune the rewriter LLM, internalizing task-specific optimization patterns and enabling efficient, high-quality prompt generation even before inference. Extensive experiments across five state-of-the-art T2V models and five benchmarks demonstrate that RAPO++ achieves significant gains in semantic alignment, compositional reasoning, temporal stability, and physical plausibility, outperforming existing methods by large margins. Our results highlight RAPO++ as a model-agnostic, cost-efficient, and scalable solution that sets a new standard for prompt optimization in T2V generation. The code is available at https://github.com/Vchitect/RAPO.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 88 of its 94 references that are in the map. First posted on arXiv 23 Oct 2025.

Builds on

88 of 94 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewriting4 Sep
  2. 2025RePrompt: Reasoning-Augmented Reprompting for Text-to-Image Generation via Reinforcement Learning23 May

Other references · 86

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  9. 2022Scalable Diffusion Models with Transformerscited by 6,054
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  11. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  12. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
38 more
  1. 2023Qwen Technical Reportcited by 3,344
  2. 2023Mistral 7Bcited by 3,164
  3. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  5. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  6. 2022Video Diffusion Modelscited by 2,305
  7. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  8. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  9. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  10. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  11. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  12. 2025s1: Simple test-time scalingcited by 1,341
  13. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  14. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  15. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
  16. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  17. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  18. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  19. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
  20. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
  21. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
  22. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 484
  23. 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 388
  24. 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
  25. 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
  26. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
  27. 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 307
  28. 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 302
  29. 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Stepscited by 234
  30. 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 233
  31. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
  32. 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?cited by 223
  33. 2021Design Guidelines for Prompt Engineering Text-to-Image Generative Modelscited by 218
  34. 2022Optimizing Prompts for Text-to-Image Generationcited by 207
  35. 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 197
  36. 2025Remasking Discrete Diffusion Models with Inference-Time Scalingcited by 189
  37. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 185
  38. 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 180

50 most cited of 86 All 86 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025VPO: Aligning Text-to-Video Generation Models with Prompt Optimization
  2. 2024Prompt-A-Video: Prompt Your Video Diffusion Model via Preference-Aligned LLM
  3. 2023POS: A Prompts Optimization Suite for Augmenting Text-to-Video Generation
  4. 2026Retrieval, Refinement, and Ranking for Text-to-Video Generation via Prompt Optimization and Test-Time Scaling
  5. 2025ConceptMix++: Leveling the Playing Field in Text-to-Image Benchmarking via Iterative Prompt Optimization
  6. 2025Multimodal Prompt Optimization: Why Not Leverage Multiple Modalities for MLLMs
  7. 2024Batch-Instructed Gradient for Prompt Evolution:Systematic Prompt Optimization for Enhanced Text-to-Image Synthesis
  8. 2025POET: Preference Optimization for Enhanced Text-to-Image Generation