mlsanityData to 7 Oct 2026

CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers

arXiv 2204.14217 ↗First posted 28 Apr 2022cs.CV cs.LGcited by 305

Not on the map. Why?

Cited by 123 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

The development of the transformer-based text-to-image models are impeded by its slow generation and complexity for high-resolution images. In this work, we put forward a solution based on hierarchical transformers and local parallel auto-regressive generation. We pretrain a 6B-parameter transformer with a simple and flexible self-supervised task, Cross-modal general language model (CogLM), and finetune it for fast super-resolution. The new text-to-image system, CogView2, shows very competitive generation compared to concurrent state-of-the-art DALL-E-2, and naturally supports interactive text-guided editing on images.

Key facts. Cited by 305 papers in the map (data through 7 Oct 2026). Builds on 33 of its 45 references that are in the map. First posted on arXiv 28 Apr 2022.

Builds on

33 of 45 references.

References · 33

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  6. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  7. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  8. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  10. 2022Generative Adversarial Networkscited by 5,603
  11. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  12. 2017Neural Discrete Representation Learningcited by 4,650
21 more
  1. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  2. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  3. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  4. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  5. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  6. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
  7. 2022MaskGIT: Masked Generative Image Transformercited by 1,082
  8. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
  9. 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
  10. 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 671
  11. 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
  12. 2018Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidatescited by 632
  13. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  14. 2019DM-GAN: Dynamic Memory Generative Adversarial Networks for Text-to-Image Synthesiscited by 308
  15. 2014Caffe: Convolutional Architecture for Fast Feature Embeddingcited by 287
  16. 2021Cross-Modal Contrastive Learning for Text-to-Image Generationcited by 259
  17. 2021N"UWA: Visual Synthesis Pre-training for Neural visUal World creAtioncited by 253
  18. 2021LAFITE: Towards Language-Free Training for Text-to-Image Generationcited by 126
  19. 2020Glancing Transformer for Non-Autoregressive Neural Machine Translationcited by 103
  20. 2021M6-UFC: Unifying Multi-Modal Controls for Conditional Image Synthesis via Non-Autoregressive Generative Transformerscited by 36
  21. 2017Fast Generation for Convolutional Autoregressive Modelscited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 25; 2023: 120; 2024: 95; 2025: 52; 2026: 13.

305 papers.

Sort:

By area:

  1. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  2. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  3. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  4. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  5. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
  6. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
  7. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  8. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  9. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
  10. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
  11. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
  12. 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
38 more
  1. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 463
  2. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
  3. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
  4. 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 386
  5. 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
  6. 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generationcited by 330
  7. 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 324
  8. 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Modelscited by 323
  9. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
  10. 2023Ablating Concepts in Text-to-Image Diffusion Modelscited by 312
  11. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
  12. 2023Training-Free Layout Control with Cross-Attention Guidancecited by 312
  13. 2024MACE: Mass Concept Erasure in Diffusion Modelscited by 298
  14. 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 296
  15. 2022Inversion-Based Style Transfer with Diffusion Modelscited by 290
  16. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
  17. 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 254
  18. 2023Using Human Feedback to Fine-tune Diffusion Models without Any Reward Modelcited by 246
  19. 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 229
  20. 2022SpaText: Spatio-Textual Representation for Controllable Image Generationcited by 217
  21. 2023PMC-CLIP: Contrastive Language-Image Pre-training using Biomedical Documentscited by 212
  22. 2023JourneyDB: A Benchmark for Generative Image Understandingcited by 203
  23. 2023A Survey on Video Diffusion Modelscited by 203
  24. 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 196
  25. 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Compositioncited by 182
  26. 2022ReCo: Region-Controlled Text-to-Image Generationcited by 177
  27. 2023NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generationcited by 170
  28. 2023Grounded Text-to-Image Synthesis with Attention Refocusingcited by 163
  29. 2023Holistic Evaluation of Text-To-Image Modelscited by 160
  30. 2023Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generationcited by 153
  31. 2023Latent-Shift: Latent Diffusion with Temporal Shift for Efficient Text-to-Video Generationcited by 137
  32. 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoisingcited by 135
  33. 2023Cross-Image Attention for Zero-Shot Appearance Transfercited by 135
  34. 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
  35. 2023Grounding Language Models to Images for Multimodal Inputs and Outputscited by 129
  36. 2023MMM: Generative Masked Motion Modelcited by 129
  37. 2024HART: Efficient Visual Generation with Hybrid Autoregressive Transformercited by 128
  38. 2023ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Modelscited by 127

50 most cited of 305 All 305 (JSON)