mlsanityData to 14 Oct 2026

FlowDCN: Exploring DCN-like Architectures for Fast Image Generation with Arbitrary Resolution

arXiv 2410.22655 ↗First posted 30 Oct 2024cs.CVcited by 16

Not on the map. Why?

Abstract (arXiv)

Arbitrary-resolution image generation still remains a challenging task in AIGC, as it requires handling varying resolutions and aspect ratios while maintaining high visual quality. Existing transformer-based diffusion methods suffer from quadratic computation cost and limited resolution extrapolation capabilities, making them less effective for this task. In this paper, we propose FlowDCN, a purely convolution-based generative model with linear time and memory complexity, that can efficiently generate high-quality images at arbitrary resolutions. Equipped with a new design of learnable group-wise deformable convolution block, our FlowDCN yields higher flexibility and capability to handle different resolutions with a single model. FlowDCN achieves the state-of-the-art 4.30 sFID on 256×256 ImageNet Benchmark and comparable resolution extrapolation results, surpassing transformer-based counterparts in terms of convergence speed (only frac15 images), visual quality, parameters (8% reduction) and FLOPs (20% reduction). We believe FlowDCN offers a promising solution to scalable and flexible image synthesis.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 32 of its 42 references that are in the map. First posted on arXiv 30 Oct 2024.

Builds on

32 of 42 references.

References · 32

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2022Scalable Diffusion Models with Transformerscited by 6,054
  9. 2022Flow Matching for Generative Modelingcited by 5,702
  10. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  11. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  12. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
20 more
  1. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  2. 2022A ConvNet for the 2020scited by 3,579
  3. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  4. 2016Improved Techniques for Training GANscited by 2,970
  5. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  6. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
  7. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
  8. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
  9. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
  10. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
  11. 2018Deformable ConvNets v2: More Deformable, Better Resultscited by 670
  12. 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 502
  13. 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 492
  14. 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 482
  15. 2021Generating Images with Sparse Representationscited by 266
  16. 2023MDTv2: Masked Diffusion Transformer is a Strong Image Synthesizercited by 262
  17. 2023ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Modelscited by 128
  18. 2024FiT: Flexible Vision Transformer for Diffusion Modelcited by 85
  19. 2023Diffusion Models Without Attentioncited by 75
  20. 2024Efficient Deformable ConvNets: Rethinking Dynamic and Sparse Operator for Vision Applicationscited by 50

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 10; 2026: 6.

16 papers.

Sort:

By area: