Vision + Language Applications: A Survey
Not on the map. Why?
Abstract (arXiv)
Text-to-image generation has attracted significant interest from researchers and practitioners in recent years due to its widespread and diverse applications across various industries. Despite the progress made in the domain of vision and language research, the existing literature remains relatively limited, particularly with regard to advancements and applications in this field. This paper explores a relevant research track within multimodal applications, including text, vision, audio, and others. In addition to the studies discussed in this paper, we are also committed to continually updating the latest relevant papers, datasets, application projects and corresponding information at https://github.com/Yutong-Zhou-cv/Awesome-Text-to-Image
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 178 of its 232 references that are in the map. First posted on arXiv 24 May 2023.
Builds on
178 of 232 references.
References · 178
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Generative Adversarial Networkscited by 5,627
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
38 more
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2016Improved Techniques for Training GANscited by 2,970
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021Learning to Prompt for Vision-Language Modelscited by 2,281
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2014Conditional Generative Adversarial Netscited by 2,162
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,433
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2022Human Motion Diffusion Modelcited by 1,080
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 774
- 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 752
- 2022OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Frameworkcited by 745
- 2016Generative Adversarial Text to Image Synthesiscited by 735
- 2022Autoregressive Image Generation using Residual Quantizationcited by 722
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
- 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 694
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 668
- 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
- 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 648
50 most cited of 178 All 178 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 2; 2026: 1.
8 papers.
- 2023A Survey on Video Diffusion Modelscited by 206
- 2024Multimodal Alignment and Fusion: A Surveycited by 74
- 2024K-Sort Arena: Efficient and Reliable Benchmarking for Generative Models via K-wise Human Preferencescited by 16
- 2024Training and Serving System of Foundation Models: A Comprehensive Surveycited by 11
- 2025V-ITI: Mitigating Hallucinations in Multimodal Large Language Models via Visual Inference-Time Interventioncited by 3
- 2025MrM: Black-Box Membership Inference Attacks against Multimodal RAG Systemscited by 2
- 2026VideoWeave: A Data-Centric Approach for Efficient Video Understandingcited by 2
- 2024MiniGPT-Reverse-Designing: Predicting Image Adjustments Utilizing MiniGPT-4cited by 0
- 2026VideoWeave: A Data-Centric Approach for Efficient Video Understanding9 Jan 2026
- 2025V-ITI: Mitigating Hallucinations in Multimodal Large Language Models via Visual Inference-Time Intervention3 Dec 2025
- 2025MrM: Black-Box Membership Inference Attacks against Multimodal RAG Systems9 Jun 2025
- 2024Multimodal Alignment and Fusion: A Survey26 Nov 2024
- 2024K-Sort Arena: Efficient and Reliable Benchmarking for Generative Models via K-wise Human Preferences26 Aug 2024
- 2024MiniGPT-Reverse-Designing: Predicting Image Adjustments Utilizing MiniGPT-43 Jun 2024
- 2024Training and Serving System of Foundation Models: A Comprehensive Survey5 Jan 2024
- 2023A Survey on Video Diffusion Models16 Oct 2023