Text-guided Image-and-Shape Editing and Generation: A Short Survey
Not on the map. Why?
Abstract (arXiv)
Image and shape editing are ubiquitous among digital artworks. Graphics algorithms facilitate artists and designers to achieve desired editing intents without going through manually tedious retouching. In the recent advance of machine learning, artists' editing intents can even be driven by text, using a variety of well-trained neural networks. They have seen to be receiving an extensive success on such as generating photorealistic images, artworks and human poses, stylizing meshes from text, or auto-completion given image and shape priors. In this short survey, we provide an overview over 50 papers on state-of-the-art (text-guided) image-and-shape generation techniques. We start with an overview on recent editing algorithms in the introduction. Then, we provide a comprehensive review on text-guided editing techniques for 2D and 3D independently, where each of its sub-section begins with a brief background introduction. We also contextualize editing algorithms under recent implicit neural representations. Finally, we conclude the survey with the discussion over existing methods and potential research ideas.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 87 of its 131 references that are in the map. First posted on arXiv 18 Apr 2023.
Builds on
87 of 131 references.
References · 87
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Generative Adversarial Networkscited by 5,603
38 more
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2017Neural Discrete Representation Learningcited by 4,650
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2016HyperNetworkscited by 1,003
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2016Generative Adversarial Text to Image Synthesiscited by 735
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
- 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 575
- 2021Carbon Emissions and Large Neural Network Trainingcited by 561
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 2023Aligning Text-to-Image Models using Human Feedbackcited by 418
- 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
- 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 332
- 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
- 2017A Neural Representation of Sketch Drawingscited by 311
- 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
- 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
- 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
- 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
50 most cited of 87 All 87 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 0; 2026: 1.
3 papers.
- 2023Aligning Synthetic Medical Images with Clinical Knowledge using Human Feedbackcited by 14
- 2024Text-to-3D Shape Generationcited by 13
- 2026Deep Sketch-Based 3D Modeling: A Surveycited by 3
- 2026Deep Sketch-Based 3D Modeling: A Survey22 Jan 2026
- 2024Text-to-3D Shape Generation20 Mar 2024
- 2023Aligning Synthetic Medical Images with Clinical Knowledge using Human Feedback16 Jun 2023