mlsanityData to 14 Oct 2026

Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoising

arXiv 2305.18264 ↗First posted 29 May 2023cs.CVcited by 139

On the map: Diffusion models → Video generation

Abstract (arXiv)

Leveraging large-scale image-text datasets and advancements in diffusion models, text-driven generative models have made remarkable strides in the field of image generation and editing. This study explores the potential of extending the text-driven ability to the generation and editing of multi-text conditioned long videos. Current methodologies for video generation and editing, while innovative, are often confined to extremely short videos (typically less than 24 frames) and are limited to a single text condition. These constraints significantly limit their applications given that real-world videos usually consist of multiple segments, each bearing different semantic information. To address this challenge, we introduce a novel paradigm dubbed as Gen-L-Video, capable of extending off-the-shelf short video diffusion models for generating and editing videos comprising hundreds of frames with diverse semantic segments without introducing additional training, all while preserving content consistency. We have implemented three mainstream text-driven video generation and editing methodologies and extended them to accommodate longer videos imbued with a variety of semantic segments with our proposed paradigm. Our experimental outcomes reveal that our approach significantly broadens the generative and editing capabilities of video diffusion models, offering new possibilities for future research and applications. The code is available at https://github.com/G-U-N/Gen-L-Video.

Key facts. Cited by 139 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 68 of its 76 references that are in the map. First posted on arXiv 29 May 2023.

Builds on

68 of 76 references.

Closest ancestors · 15

Same direction, newest first

  1. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators23 Mar
  2. 2023Pix2Video: Video Editing using Image Diffusion22 Mar
  3. 2023NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation22 Mar
  4. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editing16 Mar
  5. 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generation15 Mar
  6. 2023Video Probabilistic Diffusion Models in Projected Latent Space15 Feb
  7. 2023Structure and Content-Guided Video Synthesis with Diffusion Models6 Feb
  8. 2023Dreamix: Video Diffusion Models are General Video Editors2 Feb
  9. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec
  10. 2022SinFusion: Training Diffusion Models on a Single Image or Video21 Nov
  11. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Models20 Nov
  12. 2022Imagen Video: High Definition Video Generation with Diffusion Models5 Oct
3 more
  1. 2022Flexible Diffusion Modeling of Long Videos23 May
  2. 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation19 May
  3. 2022Video Diffusion Models7 Apr

Other references · 53

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2023Segment Anythingcited by 8,234
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  9. 2022Classifier-Free Diffusion Guidancecited by 5,847
  10. 2022Generative Adversarial Networkscited by 5,627
  11. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  12. 2017Neural Discrete Representation Learningcited by 4,712
38 more
  1. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  2. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  3. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  4. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  5. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  6. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  7. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  8. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  9. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  10. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  11. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
  12. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  13. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
  14. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
  15. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  16. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  17. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 774
  18. 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
  19. 2021Vector-quantized Image Modeling with Improved VQGANcited by 658
  20. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
  21. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  22. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 484
  23. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
  24. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
  25. 2019DM-GAN: Dynamic Memory Generative Adversarial Networks for Text-to-Image Synthesiscited by 308
  26. 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 307
  27. 2021Cross-Modal Contrastive Learning for Text-to-Image Generationcited by 259
  28. 2021N"UWA: Visual Synthesis Pre-training for Neural visUal World creAtioncited by 253
  29. 2022Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformercited by 244
  30. 2022FOSTER: Feature Boosting and Compression for Class-Incremental Learningcited by 229
  31. 2017Video Generation From Textcited by 154
  32. 2023Continual Diffusion: Continual Customization of Text-to-Image Diffusion with C-LoRAcited by 141
  33. 2018To Create What You Tell: Generating Videos from Captionscited by 84
  34. 2021PyCIL: A Python Toolbox for Class-Incremental Learningcited by 83
  35. 2022NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesiscited by 71
  36. 2022Unifying Diffusion Models' Latent Space, with Applications to CycleDiffusion and Guidancecited by 67
  37. 2021Improving Text-to-Image Synthesis Using Contrastive Learningcited by 62
  38. 2018Imagine This! Scripts to Compositions to Videoscited by 54

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 10; 2024: 58; 2025: 44; 2026: 27.

139 papers.

Sort:

By area:

  1. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
  2. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
  3. 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 251
  4. 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 233
  5. 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 211
  6. 2023A Survey on Video Diffusion Modelscited by 206
  7. 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 180
  8. 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 143
  9. 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 141
  10. 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 137
  11. 2025Long-Context Autoregressive Video Modeling with Next-Frame Predictioncited by 123
  12. 2025Epona: Autoregressive Diffusion World Model for Autonomous Drivingcited by 117
38 more
  1. 2025Long Context Tuning for Video Generationcited by 113
  2. 2024Adaptive Caching for Faster Video Generation with Diffusion Transformerscited by 108
  3. 2025Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generationcited by 101
  4. 2024Video-LaVIT: Unified Video-Language Pre-training with Decoupled Visual-Motional Tokenizationcited by 100
  5. 2024Loong: Generating Minute-level Long Videos with Autoregressive Language Modelscited by 99
  6. 2023Animate-A-Story: Storytelling with Retrieval-Augmented Video Generationcited by 90
  7. 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 90
  8. 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Modelcited by 89
  9. 2024MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequencecited by 89
  10. 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attentioncited by 89
  11. 2024Phased Consistency Modelscited by 85
  12. 2024Ca2-VDM: Efficient Autoregressive Video Diffusion Model with Causal Generation and Cache Sharingcited by 74
  13. 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generationcited by 74
  14. 2025SkyReels-A2: Compose Anything in Video Diffusion Transformerscited by 73
  15. 2024Vlogger: Make Your Dream A Vlogcited by 70
  16. 2024Progressive Autoregressive Video Diffusion Modelscited by 68
  17. 2024Evaluation of Text-to-Video Generation Models: A Dynamics Perspectivecited by 67
  18. 2024Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Modelcited by 66
  19. 2025RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformerscited by 66
  20. 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videoscited by 64
  21. 2023MagicStick: Controllable Video Editing via Control Handle Transformationscited by 62
  22. 2024FreeTraj: Tuning-Free Trajectory Control in Video Diffusion Modelscited by 56
  23. 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 54
  24. 2024Follow-Your-Click: Open-domain Regional Image Animation via Short Promptscited by 52
  25. 2024VideoTetris: Towards Compositional Text-to-Video Generationcited by 51
  26. 2025StreamDiT: Real-Time Streaming Text-to-Video Generationcited by 48
  27. 2023RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Modelcited by 47
  28. 2025StableAvatar: Infinite-Length Audio-Driven Avatar Video Generationcited by 44
  29. 2024Efficient Diffusion Models: A Comprehensive Survey from Principles to Practicescited by 41
  30. 2023MEVG: Multi-event Video Generation with Text-to-Video Modelscited by 40
  31. 2024Vivid-ZOO: Multi-View Video Generation with Diffusion Modelcited by 40
  32. 2024Mind the Time: Temporally-Controlled Multi-Event Video Generationcited by 40
  33. 2025ShotAdapter: Text-to-Multi-Shot Video Generation with Diffusion Modelscited by 38
  34. 2024ViD-GPT: Introducing GPT-style Autoregressive Generation in Video Diffusion Modelscited by 36
  35. 2024LLMs Meet Multimodal Generation and Editing: A Surveycited by 35
  36. 2024TRIP: Temporal Residual Learning with Image Noise Prior for Image-to-Video Diffusion Modelscited by 31
  37. 2025World Models for Learning Dexterous Hand-Object Interactions from Human Videoscited by 31
  38. 2024Video Diffusion Models: A Surveycited by 30

50 most cited of 139 All 139 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Video Text Preservation with Synthetic Text-Rich Videos
  2. 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Models
  3. 2024I4VGen: Image as Free Stepping Stone for Text-to-Video Generation
  4. 2023VideoGen: A Reference-Guided Latent Diffusion Approach for High Definition Text-to-Video Generation
  5. 2025TokensGen: Harnessing Condensed Tokens for Long Video Generation
  6. 2023Free-Bloom: Zero-Shot Text-to-Video Generator with LLM Director and LDM Animator
  7. 2026Towards Error-Free Long Video Generation
  8. 2023A Recipe for Scaling up Text-to-Video Generation with Text-free Videos