mlsanityData to 7 Oct 2026

TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Prompts

arXiv 2401.14828 ↗First posted 26 Jan 2024cs.CVcited by 76

Not on the map. Why?

Abstract (arXiv)

Text-driven 3D scene editing has gained significant attention owing to its convenience and user-friendliness. However, existing methods still lack accurate control of the specified appearance and location of the editing result due to the inherent limitations of the text description. To this end, we propose a 3D scene editing framework, TIPEditor, that accepts both text and image prompts and a 3D bounding box to specify the editing region. With the image prompt, users can conveniently specify the detailed appearance/style of the target content in complement to the text description, enabling accurate control of the appearance. Specifically, TIP-Editor employs a stepwise 2D personalization strategy to better learn the representation of the existing scene and the reference image, in which a localization loss is proposed to encourage correct object placement as specified by the bounding box. Additionally, TIPEditor utilizes explicit and flexible 3D Gaussian splatting as the 3D representation to facilitate local editing while keeping the background unchanged. Extensive experiments have demonstrated that TIP-Editor conducts accurate editing following the text and image prompts in the specified bounding box region, consistently outperforming the baselines in editing quality, and the alignment to the prompts, qualitatively and quantitatively.

Key facts. Cited by 76 papers in the map (data through 7 Oct 2026). Builds on 56 of its 70 references that are in the map. First posted on arXiv 26 Jan 2024.

Builds on

56 of 70 references.

References · 56

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2023Segment Anythingcited by 8,158
  7. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  10. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  11. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  12. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
38 more
  1. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  2. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  3. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  4. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  5. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  6. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  7. 2021Vision Transformers for Dense Predictioncited by 1,789
  8. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  9. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  10. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  11. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  12. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  13. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  14. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  15. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  16. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
  17. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
  18. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  19. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 370
  20. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
  21. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
  22. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
  23. 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
  24. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
  25. 2023Text-to-3D using Gaussian Splattingcited by 299
  26. 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
  27. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 216
  28. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 166
  29. 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priorscited by 156
  30. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 154
  31. 2022NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editingcited by 141
  32. 2021MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesiscited by 133
  33. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  34. 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 114
  35. 2021NeuTex: Neural Texture Mapping for Volumetric Neural Renderingcited by 98
  36. 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Fieldcited by 93
  37. 2022Compressible-composable NeRF via Rank-residual Decompositioncited by 92
  38. 2022Deforming Radiance Fields with Cagescited by 78

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 21; 2025: 35; 2026: 20.

76 papers.

Sort:

By area:

  1. 20243D Gaussian as a New Era: A Surveycited by 102
  2. 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
  3. 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 60
  4. 2024SemGauss-SLAM: Dense Semantic Gaussian Splatting SLAMcited by 41
  5. 2025VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Spacecited by 40
  6. 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesiscited by 34
  7. 2024GStex: Per-Primitive Texturing of 2D Gaussian Splatting for Decoupled Appearance and Geometry Modelingcited by 30
  8. 2024A Survey on Personalized Content Synthesis with Diffusion Modelscited by 29
  9. 2024AutoVFX: Physically Realistic Video Editing from Natural Language Instructionscited by 27
  10. 2025Drag Your Gaussian: Effective Drag-Based Editing with Score Distillation for 3D Gaussian Splattingcited by 21
  11. 2024Consolidating Attention Features for Multi-view Image Editingcited by 19
  12. 2025EditP23: 3D Editing via Propagation of Image Prompts to Multi-Viewcited by 19
38 more
  1. 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
  2. 2024StyleSplat: 3D Object Style Transfer with Gaussian Splattingcited by 18
  3. 2025CMD: Controllable Multiview Diffusion for 3D Editing and Progressive Generationcited by 14
  4. 2024A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generationcited by 13
  5. 2024GS-VTON: Controllable 3D Virtual Try-on with Gaussian Splattingcited by 13
  6. 2024ICE-G: Image Conditional Editing of 3D Gaussian Splatscited by 11
  7. 2025Pro3D-Editor : A Progressive-Views Perspective for Consistent and Precise 3D Editingcited by 11
  8. 2024OmniSplat: Taming Feed-Forward 3D Gaussian Splatting for Omnidirectional Images with Editable Capabilitiescited by 10
  9. 2025VTON 360: High-Fidelity Virtual Try-On from Any Viewing Directioncited by 10
  10. 2025Tinker: Diffusion's Gift to 3D--Multi-View Consistent Editing From Sparse Inputs without Per-Scene Optimizationcited by 9
  11. 2025Towards Scalable and Consistent 3D Editingcited by 9
  12. 2025AdLift: Lifting Adversarial Perturbations to Safeguard 3D Gaussian Splatting Assets Against Instruction-Driven Editingcited by 9
  13. 2024Generative Object Insertion in Gaussian Splatting with a Multi-View Diffusion Modelcited by 6
  14. 2024GSEditPro: 3D Gaussian Splatting Editing with Attention-based Progressive Localizationcited by 6
  15. 2025Feedforward 3D Editing via Text-Steerable Image-to-3Dcited by 6
  16. 2024DAGSM: Disentangled Avatar Generation with GS-enhanced Meshcited by 5
  17. 2025ARAP-GS: Drag-driven As-Rigid-As-Possible 3D Gaussian Splatting Editing with Diffusion Priorcited by 5
  18. 2025FreeInsert: Disentangled Text-Guided Object Insertion in 3D Gaussian Scene without Spatial Priorscited by 5
  19. 2025CoreEditor: Correspondence-constrained Diffusion for Consistent 3D Editingcited by 5
  20. 2025EditCast3D: Single-Frame-Guided 3D Editing with Video Propagation and View Selectioncited by 5
  21. 2025SplatPainter: Interactive Authoring of 3D Gaussians from 2D Edits via Test-Time Trainingcited by 5
  22. 2024Dual-Camera Smooth Zoom on Mobile Phonescited by 4
  23. 2024NeRF-Insert: 3D Local Editing with Multimodal Control Signalscited by 4
  24. 2025Coupled Diffusion Sampling for Training-Free Multi-View Image Editingcited by 4
  25. 2026VecSet-Edit: Unleashing Pre-trained LRM for Mesh Editing from Single Imagecited by 4
  26. 2025GaussianAvatar-Editor: Photorealistic Animatable Gaussian Head Avatar Editorcited by 3
  27. 2025CAGE-GS: High-fidelity Cage Based 3D Gaussian Splatting Deformationcited by 3
  28. 2025Creating Your Editable 3D Photorealistic Avatar with Tetrahedron-constrained Gaussian Splattingcited by 3
  29. 2025AvatarMakeup: Realistic Makeup Transfer for 3D Animatable Head Avatarscited by 3
  30. 2025CraftMesh: High-Fidelity Generative Mesh Manipulation via Poisson Seamless Fusioncited by 3
  31. 2025Native 3D Editing with Full Attentioncited by 3
  32. 20253D Scene Change Modeling With Consistent Multi-View Aggregationcited by 3
  33. 2026ShapeUP: Scalable Image-Conditioned 3D Editingcited by 3
  34. 2026Vinedresser3D: Agentic Text-guided 3D Editingcited by 3
  35. 2024Manipulating Vehicle 3D Shapes through Latent Space Editingcited by 2
  36. 2025Personalize Your Gaussian: Consistent 3D Scene Personalization from a Single Imagecited by 2
  37. 20253D PixBrush: Image-Guided Local Texture Synthesiscited by 2
  38. 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Maskingcited by 2

50 most cited of 76 All 76 (JSON)