Lower Dimensional Kernels for Video Discriminators
Not on the map. Why?
Abstract (arXiv)
This work presents an analysis of the discriminators used in Generative Adversarial Networks (GANs) for Video. We show that unconstrained video discriminator architectures induce a loss surface with high curvature which make optimisation difficult. We also show that this curvature becomes more extreme as the maximal kernel dimension of video discriminators increases. With these observations in hand, we propose a family of efficient Lower-Dimensional Video Discriminators for GANs (LDVD GANs). The proposed family of discriminators improve the performance of video GAN models they are applied to and demonstrate good performance on complex and diverse datasets such as UCF-101. In particular, we show that they can double the performance of Temporal-GANs and provide for state-of-the-art performance on a single GPU.
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 9; 2023: 10; 2024: 8; 2025: 2.
37 papers.
Sort:
By area:
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2022Video Diffusion Modelscited by 2,280
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
- 2022MAGVIT: Masked Generative Video Transformercited by 341
- 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 300
- 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Modelscited by 284
- 2022Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformercited by 244
- 2022Generating Videos with Dynamics-aware Implicit Generative Adversarial Networkscited by 186
- 2023Video Probabilistic Diffusion Models in Projected Latent Spacecited by 171
- 2021A Good Image Generator Is What You Need for High-Resolution Video Synthesiscited by 162
25 more
- 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 140
- 2022Diffusion Models for Video Prediction and Infillingcited by 134
- 2023SimDA: Simple Diffusion Adapter for Efficient Video Generationcited by 101
- 2022VIDM: Video Implicit Diffusion Modelscited by 78
- 2021CCVS: Context-aware Controllable Video Synthesiscited by 68
- 2021StyleVideoGAN: A Temporal Generative Model using a Pretrained StyleGANcited by 47
- 2021FReTAL: Generalizing Deepfake Detection using Knowledge Distillation and Representation Learningcited by 43
- 2021CoReD: Generalizing Fake Media Detection with Continual Representation using Distillationcited by 37
- 2022Show Me What and Tell Me How: Video Synthesis via Multimodal Conditioningcited by 37
- 2023Dysen-VDM: Empowering Dynamics-aware Text-to-Video Diffusion with LLMscited by 35
- 2024Video Diffusion Models: A Surveycited by 28
- 2024Matten: Video Generation with Mamba-Attentioncited by 24
- 2024AID: Adapting Image2Video Diffusion Models for Instruction-guided Video Predictioncited by 20
- 2023StyleInV: A Temporal Style Modulated Inversion Network for Unconditional Video Generationcited by 19
- 20223D-Aware Video Generationcited by 17
- 2025MALT Diffusion: Memory-Augmented Latent Transformers for Any-Length Video Generationcited by 14
- 2025Video-GPT via Next Clip Diffusioncited by 8
- 2023Towards End-to-End Generative Modeling of Long Videos with Memory-Efficient Bidirectional Transformerscited by 7
- 2023MotionVideoGAN: A Novel Video Generator Based on the Motion Space Learned from Image Pairscited by 5
- 2024Generative AI-based data augmentation for improved bioacoustic classification in noisy environmentscited by 1
- 2021Xp-GAN: Unsupervised Multi-object Controllable Video Generationcited by 0
- 2022Autoencoding Video Latents for Adversarial Video Generationcited by 0
- 2023MeVGAN: GAN-based Plugin Model for Video Generation with Applications in Colonoscopycited by 0
- 2024JVID: Joint Video-Image Diffusion for Visual-Quality and Temporal-Consistency in Video Generationcited by 0
- 2024COMUNI: Decomposing Common and Unique Video Signals for Diffusion-based Video Generationcited by 0
- 2025Video-GPT via Next Clip Diffusion18 May 2025
- 2025MALT Diffusion: Memory-Augmented Latent Transformers for Any-Length Video Generation18 Feb 2025
- 2024Generative AI-based data augmentation for improved bioacoustic classification in noisy environments2 Dec 2024
- 2024COMUNI: Decomposing Common and Unique Video Signals for Diffusion-based Video Generation2 Oct 2024
- 2024JVID: Joint Video-Image Diffusion for Visual-Quality and Temporal-Consistency in Video Generation21 Sep 2024
- 2024Real-Time Video Generation with Pyramid Attention Broadcast22 Aug 2024
- 2024AID: Adapting Image2Video Diffusion Models for Instruction-guided Video Prediction10 Jun 2024
- 2024Video Diffusion Models: A Survey6 May 2024
- 2024Matten: Video Generation with Mamba-Attention5 May 2024
- 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan 2024
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov 2023
- 2023MeVGAN: GAN-based Plugin Model for Video Generation with Applications in Colonoscopy7 Nov 2023
25 more
- 2023StyleInV: A Temporal Style Modulated Inversion Network for Unconditional Video Generation31 Aug 2023
- 2023Dysen-VDM: Empowering Dynamics-aware Text-to-Video Diffusion with LLMs26 Aug 2023
- 2023SimDA: Simple Diffusion Adapter for Efficient Video Generation18 Aug 2023
- 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Models17 May 2023
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr 2023
- 2023Towards End-to-End Generative Modeling of Long Videos with Memory-Efficient Bidirectional Transformers20 Mar 2023
- 2023MotionVideoGAN: A Novel Video Generator Based on the Motion Space Learned from Image Pairs6 Mar 2023
- 2023Video Probabilistic Diffusion Models in Projected Latent Space15 Feb 2023
- 2022MAGVIT: Masked Generative Video Transformer10 Dec 2022
- 2022VIDM: Video Implicit Diffusion Models1 Dec 2022
- 20223D-Aware Video Generation29 Jun 2022
- 2022Diffusion Models for Video Prediction and Infilling15 Jun 2022
- 2022Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformer7 Apr 2022
- 2022Video Diffusion Models7 Apr 2022
- 2022Show Me What and Tell Me How: Video Synthesis via Multimodal Conditioning4 Mar 2022
- 2022Generating Videos with Dynamics-aware Implicit Generative Adversarial Networks21 Feb 2022
- 2022Autoencoding Video Latents for Adversarial Video Generation18 Jan 2022
- 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN229 Dec 2021
- 2021Xp-GAN: Unsupervised Multi-object Controllable Video Generation19 Nov 2021
- 2021CCVS: Context-aware Controllable Video Synthesis16 Jul 2021
- 2021StyleVideoGAN: A Temporal Generative Model using a Pretrained StyleGAN15 Jul 2021
- 2021CoReD: Generalizing Fake Media Detection with Continual Representation using Distillation6 Jul 2021
- 2021FReTAL: Generalizing Deepfake Detection using Knowledge Distillation and Representation Learning28 May 2021
- 2021A Good Image Generator Is What You Need for High-Resolution Video Synthesis30 Apr 2021
- 2021VideoGPT: Video Generation using VQ-VAE and Transformers20 Apr 2021
- 2022Video Diffusion Modelscited by 2,280
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
- 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Modelscited by 284
- 2023Video Probabilistic Diffusion Models in Projected Latent Spacecited by 171
- 2022Diffusion Models for Video Prediction and Infillingcited by 134
- 2022VIDM: Video Implicit Diffusion Modelscited by 78
- 2023Dysen-VDM: Empowering Dynamics-aware Text-to-Video Diffusion with LLMscited by 35
- 2024Video Diffusion Models: A Surveycited by 28
- 2024Matten: Video Generation with Mamba-Attentioncited by 24
- 2024AID: Adapting Image2Video Diffusion Models for Instruction-guided Video Predictioncited by 20
- 2025MALT Diffusion: Memory-Augmented Latent Transformers for Any-Length Video Generationcited by 14
12 most cited of 15 All 15 (JSON)
- 2025MALT Diffusion: Memory-Augmented Latent Transformers for Any-Length Video Generation18 Feb 2025
- 2024Generative AI-based data augmentation for improved bioacoustic classification in noisy environments2 Dec 2024
- 2024COMUNI: Decomposing Common and Unique Video Signals for Diffusion-based Video Generation2 Oct 2024
- 2024JVID: Joint Video-Image Diffusion for Visual-Quality and Temporal-Consistency in Video Generation21 Sep 2024
- 2024AID: Adapting Image2Video Diffusion Models for Instruction-guided Video Prediction10 Jun 2024
- 2024Video Diffusion Models: A Survey6 May 2024
- 2024Matten: Video Generation with Mamba-Attention5 May 2024
- 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan 2024
- 2023Dysen-VDM: Empowering Dynamics-aware Text-to-Video Diffusion with LLMs26 Aug 2023
- 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Models17 May 2023
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr 2023
- 2023Video Probabilistic Diffusion Models in Projected Latent Space15 Feb 2023
12 newest of 15 All 15 (JSON)
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
- 2022MAGVIT: Masked Generative Video Transformercited by 341
- 2025Video-GPT via Next Clip Diffusioncited by 8
- 2025Video-GPT via Next Clip Diffusion18 May 2025
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov 2023
- 2022MAGVIT: Masked Generative Video Transformer10 Dec 2022
- 2021VideoGPT: Video Generation using VQ-VAE and Transformers20 Apr 2021
- 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 300
- 2022Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformercited by 244
- 2022Generating Videos with Dynamics-aware Implicit Generative Adversarial Networkscited by 186
- 2021A Good Image Generator Is What You Need for High-Resolution Video Synthesiscited by 162
- 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 140
- 2023SimDA: Simple Diffusion Adapter for Efficient Video Generationcited by 101
- 2021CCVS: Context-aware Controllable Video Synthesiscited by 68
- 2021StyleVideoGAN: A Temporal Generative Model using a Pretrained StyleGANcited by 47
- 2021FReTAL: Generalizing Deepfake Detection using Knowledge Distillation and Representation Learningcited by 43
- 2021CoReD: Generalizing Fake Media Detection with Continual Representation using Distillationcited by 37
- 2022Show Me What and Tell Me How: Video Synthesis via Multimodal Conditioningcited by 37
- 2023StyleInV: A Temporal Style Modulated Inversion Network for Unconditional Video Generationcited by 19
12 most cited of 18 All 18 (JSON)
- 2024Real-Time Video Generation with Pyramid Attention Broadcast22 Aug 2024
- 2023MeVGAN: GAN-based Plugin Model for Video Generation with Applications in Colonoscopy7 Nov 2023
- 2023StyleInV: A Temporal Style Modulated Inversion Network for Unconditional Video Generation31 Aug 2023
- 2023SimDA: Simple Diffusion Adapter for Efficient Video Generation18 Aug 2023
- 2023Towards End-to-End Generative Modeling of Long Videos with Memory-Efficient Bidirectional Transformers20 Mar 2023
- 2023MotionVideoGAN: A Novel Video Generator Based on the Motion Space Learned from Image Pairs6 Mar 2023
- 20223D-Aware Video Generation29 Jun 2022
- 2022Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformer7 Apr 2022
- 2022Show Me What and Tell Me How: Video Synthesis via Multimodal Conditioning4 Mar 2022
- 2022Generating Videos with Dynamics-aware Implicit Generative Adversarial Networks21 Feb 2022
- 2022Autoencoding Video Latents for Adversarial Video Generation18 Jan 2022
- 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN229 Dec 2021
12 newest of 18 All 18 (JSON)