mlsanityData to 14 Oct 2026

ReplaceAnything3D:Text-Guided 3D Scene Editing with Compositional Neural Radiance Fields

arXiv 2401.17895 ↗First posted 31 Jan 2024cs.CV cs.AI cs.GRcited by 7

Not on the map. Why?

Abstract (arXiv)

We introduce ReplaceAnything3D model (RAM3D), a novel text-guided 3D scene editing method that enables the replacement of specific objects within a scene. Given multi-view images of a scene, a text prompt describing the object to replace, and a text prompt describing the new object, our Erase-and-Replace approach can effectively swap objects in the scene with newly generated content while maintaining 3D consistency across multiple viewpoints. We demonstrate the versatility of ReplaceAnything3D by applying it to various realistic 3D scenes, showcasing results of modified foreground objects that are well-integrated with the rest of the scene without affecting its overall integrity.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 43 of its 53 references that are in the map. First posted on arXiv 31 Jan 2024.

Builds on

43 of 53 references.

References · 43

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  7. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  8. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  9. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  10. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  11. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  12. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
31 more
  1. 2021Vision Transformers for Dense Predictioncited by 1,803
  2. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  3. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
  4. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  5. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  6. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  7. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  8. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
  9. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
  10. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  11. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  12. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 671
  13. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 642
  14. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
  15. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  16. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 511
  17. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  18. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  19. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
  20. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
  21. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
  22. 2021Editing Conditional Radiance Fieldscited by 222
  23. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 217
  24. 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 195
  25. 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
  26. 2022ReLU Fields: The Little Non-linearity That Couldcited by 87
  27. 2023ATT3D: Amortized Text-to-3D Object Synthesiscited by 87
  28. 2022Removing Objects From Neural Radiance Fieldscited by 66
  29. 2023Reference-guided Controllable Inpainting of Neural Radiance Fieldscited by 40
  30. 2023DreamEdit: Subject-driven Image Editingcited by 37
  31. 2023Blending-NeRF: Text-Driven Localized Editing in Neural Radiance Fieldscited by 28

Built on by

Cited by year

Citing papers per year: 2024: 4; 2025: 3.

7 papers.

  1. 2024MVInpainter: Learning Multi-View Consistent Inpainting to Bridge 2D and 3D Editingcited by 30
  2. 2024GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Promptingcited by 22
  3. 2024EditRoom: LLM-parameterized Graph Diffusion for Composable 3D Room Layout Editingcited by 15
  4. 2024Generative Object Insertion in Gaussian Splatting with a Multi-View Diffusion Modelcited by 6
  5. 2025DiGA3D: Coarse-to-Fine Diffusional Propagation of Geometry and Appearance for Versatile 3D Inpaintingcited by 3
  6. 2025Bridging the Gap Between Multimodal Foundation Models and World Modelscited by 1
  7. 2025MorphoSim: An Interactive, Controllable, and Editable Language-guided 4D World Simulatorcited by 1