mlsanityData to 14 Oct 2026

Hierarchical Patch VAE-GAN: Generating Diverse Videos from a Single Sample

arXiv 2006.12226 ↗First posted 22 Jun 2020cs.CV cs.LGcited by 43

Not on the map. Why?

Abstract (arXiv)

We consider the task of generating diverse and novel videos from a single video sample. Recently, new hierarchical patch-GAN based approaches were proposed for generating diverse images, given only a single sample at training time. Moving to videos, these approaches fail to generate diverse samples, and often collapse into generating samples similar to the training video. We introduce a novel patch-based variational autoencoder (VAE) which allows for a much greater diversity in generation. Using this tool, a new hierarchical video generation scheme is constructed: at coarse scales, our patch-VAE is employed, ensuring samples are of high diversity. Subsequently, at finer scales, a patch-GAN renders the fine details, resulting in high quality videos. Our experiments show that the proposed method produces diverse samples in both the image domain, and the more challenging video domain.

Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). First posted on arXiv 22 Jun 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 15; 2022: 10; 2023: 5; 2024: 6; 2025: 5; 2026: 2.

43 papers.

Sort:

By area:

  1. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  2. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
  3. 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 301
  4. 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 182
  5. 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoisingcited by 139
  6. 2021A Hierarchical Transformation-Discriminating Generative Model for Few Shot Anomaly Detectioncited by 60
  7. 2022SinDDM: A Single Image Denoising Diffusion Modelcited by 60
  8. 2022SinFusion: Training Diffusion Models on a Single Image or Videocited by 58
  9. 2021Drop the GAN: In Defense of Patches Nearest Neighbors as Single Image Generative Modelscited by 51
  10. 2025VMBench: A Benchmark for Perception-Aligned Video Motion Generationcited by 49
  11. 2023Towards Consistent Video Editing with Text-to-Image Diffusion Modelscited by 34
  12. 2022Text2Light: Zero-Shot Text-Driven HDR Panorama Generationcited by 24
31 more
  1. 2024Adversarial Supervision Makes Layout-to-Image Diffusion Models Thrivecited by 18
  2. 2021Catch-A-Waveform: Learning to Generate Audio from a Single Short Examplecited by 15
  3. 2024FancyVideo: Towards Dynamic and Consistent Video Generation via Cross-frame Textual Guidancecited by 15
  4. 2021Strumming to the Beat: Audio-Conditioned Contrastive Video Texturescited by 14
  5. 2022PetsGAN: Rethinking Priors for Single Image Generationcited by 14
  6. 2021Diverse Generation from a Single Video Made Possiblecited by 13
  7. 2021ExSinGAN: Learning an Explainable Generative Model from a Single Imagecited by 12
  8. 2021A Hierarchical Variational Neural Uncertainty Model for Stochastic Video Predictioncited by 10
  9. 2025Any2Caption:Interpreting Any Condition to Caption for Controllable Video Generationcited by 10
  10. 2021MOGAN: Morphologic-structure-aware Generative Learning from a Single Imagecited by 9
  11. 2021Meta Internal Learningcited by 7
  12. 2024Video Is Worth a Thousand Images: Exploring the Latest Trends in Long Video Generationcited by 7
  13. 2026Evolution of Video Generative Foundationscited by 7
  14. 2024Segment Anything for Videos: A Systematic Surveycited by 5
  15. 2025Generative AI in Depth: A Survey of Recent Advances, Model Variants, and Real-World Applicationscited by 5
  16. 2022One-Shot Synthesis of Images and Segmentation Maskscited by 4
  17. 2021JOKR: Joint Keypoint Representation for Unsupervised Cross-Domain Motion Retargetingcited by 3
  18. 2021Diverse Single Image Generation with Controllable Global Structurecited by 2
  19. 2022BlendGAN: Learning and Blending the Internal Distributions of Single Images by Spatial Image-Identity Conditioningcited by 2
  20. 2025Towards Efficient Real-Time Video Motion Transfer via Generative Time Series Modelingcited by 2
  21. 2022One-shot Ultra-high-Resolution Generative Adversarial Network That Synthesizes 16K Images On A Single GPUcited by 1
  22. 2023TemperatureGAN: Generative Modeling of Regional Atmospheric Temperaturescited by 1
  23. 2023Infusion: internal diffusion for inpainting of dynamic textures and complex motioncited by 1
  24. 2024Few-shot Image Generation via Information Transfer from the Built Geodesic Surfacecited by 1
  25. 2024Towards Practical Single-shot Motion Synthesiscited by 1
  26. 2021SpecSinGAN: Sound Effect Variation Synthesis Using Single-Image GANscited by 0
  27. 2021LARNet: Latent Action Representation for Human Action Synthesiscited by 0
  28. 2022Diverse Video Generation from a Single Videocited by 0
  29. 2022FewGAN: Generating from the Joint Distribution of a Few Imagescited by 0
  30. 2025PathoSyn: Imaging-Pathology MRI Synthesis via Disentangled Deviation Diffusioncited by 0
  31. 2026FRPSS: Feature Rearrangement in Pre-Shape Space for Single-Image Generationcited by 0