mlsanityData to 14 Oct 2026

Obj-NeRF: Extract Object NeRFs from Multi-view Images

arXiv 2311.15291 ↗First posted 26 Nov 2023cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Neural Radiance Fields (NeRFs) have demonstrated remarkable effectiveness in novel view synthesis within 3D environments. However, extracting a radiance field of one specific object from multi-view images encounters substantial challenges due to occlusion and background complexity, thereby presenting difficulties in downstream applications such as NeRF editing and 3D mesh extraction. To solve this problem, in this paper, we propose Obj-NeRF, a comprehensive pipeline that recovers the 3D geometry of a specific object from multi-view images using a single prompt. This method combines the 2D segmentation capabilities of the Segment Anything Model (SAM) in conjunction with the 3D reconstruction ability of NeRF. Specifically, we first obtain multi-view segmentation for the indicated object using SAM with a single prompt. Then, we use the segmentation images to supervise NeRF construction, integrating several effective techniques. Additionally, we construct a large object-level NeRF dataset containing diverse objects, which can be useful in various downstream tasks. To demonstrate the practicality of our method, we also apply Obj-NeRF to various applications, including object removal, rotation, replacement, and recoloring.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 36 references that are in the map. First posted on arXiv 26 Nov 2023.

Builds on

30 of 36 references.

References · 30

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Segment Anythingcited by 8,234
  3. 2020End-to-End Object Detection with Transformerscited by 7,414
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  5. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  6. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  7. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  8. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  9. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  10. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  11. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  12. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
18 more
  1. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  2. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  3. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
  4. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  5. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
  6. 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
  7. 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 600
  8. 2023LERF: Language Embedded Radiance Fieldscited by 543
  9. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 366
  10. 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 302
  11. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 217
  12. 2019RIO: 3D Object Instance Re-Localization in Changing Indoor Environmentscited by 188
  13. 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
  14. 2021NeRF-SR: High-Quality Neural Radiance Fields using Supersamplingcited by 95
  15. 2022Compressible-composable NeRF via Rank-residual Decompositioncited by 92
  16. 2023Segment Anything in 3D with Radiance Fieldscited by 62
  17. 2023OR-NeRF: Object Removing from 3D Scenes Guided by Multiview Segmentation with Neural Radiance Fieldscited by 34
  18. 2023Interactive Segment Anything NeRF with Feature Imitationcited by 24

Built on by

Not cited yet.