mlsanityData to 7 Oct 2026

Text-guided Image-and-Shape Editing and Generation: A Short Survey

arXiv 2304.09244 ↗First posted 18 Apr 2023cs.GR cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Image and shape editing are ubiquitous among digital artworks. Graphics algorithms facilitate artists and designers to achieve desired editing intents without going through manually tedious retouching. In the recent advance of machine learning, artists' editing intents can even be driven by text, using a variety of well-trained neural networks. They have seen to be receiving an extensive success on such as generating photorealistic images, artworks and human poses, stylizing meshes from text, or auto-completion given image and shape priors. In this short survey, we provide an overview over 50 papers on state-of-the-art (text-guided) image-and-shape generation techniques. We start with an overview on recent editing algorithms in the introduction. Then, we provide a comprehensive review on text-guided editing techniques for 2D and 3D independently, where each of its sub-section begins with a brief background introduction. We also contextualize editing algorithms under recent implicit neural representations. Finally, we conclude the survey with the discussion over existing methods and potential research ideas.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 87 of its 131 references that are in the map. First posted on arXiv 18 Apr 2023.

Builds on

87 of 131 references.

References · 87

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  6. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  7. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  9. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  10. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  11. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  12. 2022Generative Adversarial Networkscited by 5,603
38 more
  1. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  2. 2017Neural Discrete Representation Learningcited by 4,650
  3. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  5. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  6. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  7. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  8. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  9. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  10. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  11. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  12. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  13. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  14. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  15. 2016HyperNetworkscited by 1,003
  16. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
  17. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  18. 2018Self-Attention Generative Adversarial Networkscited by 809
  19. 2016Generative Adversarial Text to Image Synthesiscited by 735
  20. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
  21. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  22. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  23. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
  24. 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 575
  25. 2021Carbon Emissions and Large Neural Network Trainingcited by 561
  26. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  27. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
  28. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  29. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  30. 2023Aligning Text-to-Image Models using Human Feedbackcited by 418
  31. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
  32. 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 332
  33. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
  34. 2017A Neural Representation of Sketch Drawingscited by 311
  35. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
  36. 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
  37. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  38. 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254

50 most cited of 87 All 87 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 1; 2025: 0; 2026: 1.

3 papers.