mlsanityData to 14 Oct 2026

FruitNinja: 3D Object Interior Texture Generation with Gaussian Splatting

arXiv 2411.12089 ↗First posted 18 Nov 2024cs.CV cs.GR cs.HCcited by 5

Not on the map. Why?

Abstract (arXiv)

In the real world, objects reveal internal textures when sliced or cut, yet this behavior is not well-studied in 3D generation tasks today. For example, slicing a virtual 3D watermelon should reveal flesh and seeds. Given that no available dataset captures an object's full internal structure and collecting data from all slices is impractical, generative methods become the obvious approach. However, current 3D generation and inpainting methods often focus on visible appearance and overlook internal textures. To bridge this gap, we introduce FruitNinja, the first method to generate internal textures for 3D objects undergoing geometric and topological changes. Our approach produces objects via 3D Gaussian Splatting (3DGS) with both surface and interior textures synthesized, enabling real-time slicing and rendering without additional optimization. FruitNinja leverages a pre-trained diffusion model to progressively inpaint cross-sectional views and applies voxel-grid-based smoothing to achieve cohesive textures throughout the object. Our OpaqueAtom GS strategy overcomes 3DGS limitations by employing densely distributed opaque Gaussians, avoiding biases toward larger particles that destabilize training and sharp color transitions for fine-grained textures. Experimental results show that FruitNinja substantially outperforms existing approaches, showcasing unmatched visual quality in real-time rendered internal views across arbitrary geometry manipulations.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 36 of its 45 references that are in the map. First posted on arXiv 18 Nov 2024.

Builds on

36 of 45 references.

References · 36

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  5. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  6. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  7. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  8. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  9. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  10. 2018Demystifying MMD GANscited by 1,293
  11. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  12. 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
24 more
  1. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
  2. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
  3. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
  4. 2018ABC: A Big CAD Model Dataset For Geometric Deep Learningcited by 341
  5. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
  6. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 304
  7. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 235
  8. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 217
  9. 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 179
  10. 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 174
  11. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 87
  12. 2024StyleGaussian: Instant 3D Style Transfer with Gaussian Splattingcited by 79
  13. 2021Unsupervised 3D Shape Completion through GAN Inversioncited by 70
  14. 2022Texturify: Generating Textures on 3D Shape Surfacescited by 65
  15. 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 56
  16. 2022NeuPhysics: Editable Neural Geometry and Physics from Monocular Videoscited by 50
  17. 2024Texture-GS: Disentangling the Geometry and Texture for 3D Gaussian Splatting Editingcited by 47
  18. 2024GSEdit: Efficient Text-Guided Editing of 3D Objects via Gaussian Splattingcited by 37
  19. 2023Point'n Move: Interactive Scene Object Manipulation on Gaussian Splatting Radiance Fieldscited by 27
  20. 2024GASP: Gaussian Splatting for Physic-Based Simulationscited by 24
  21. 2017Shape Inpainting using 3D Generative Adversarial Network and Recurrent Convolutional Networkscited by 23
  22. 2024Mani-GS: Gaussian Splatting Manipulation with Triangular Meshcited by 22
  23. 2024AtomGS: Atomizing Gaussian Splatting for High-Fidelity Radiance Fieldcited by 18
  24. 2023Neural Impostor: Editing Neural Radiance Fields with Explicit Shape Manipulationcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Enhancing Single Image to 3D Generation using Gaussian Splatting and Hybrid Diffusion Priors
  2. 2026WINGS: Reference-Free Gaussian Splatting Inpainting with 3D-Native Generative Priors
  3. 2025DirectTriGS: Triplane-based Gaussian Splatting Field Representation for 3D Generation
  4. 2026Benchmarking Single-Step Inpainting Methods for Multi-Object 3D Gaussian Splatting Scenes
  5. 2025Sketch and Patch: Efficient 3D Gaussian Representation for Man-Made Scenes
  6. 20263D-GIMP: When 3D Gaussian Inpainting Meets PatchMatch
  7. 2024GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstruction
  8. 2024Localized Gaussian Splatting Editing with Contextual Awareness