mlsanityData to 7 Oct 2026

Memorization in 3D Shape Generation: An Empirical Study

arXiv 2512.23628 ↗First posted 29 Dec 2025cs.CV cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Generative models are increasingly used in 3D vision to synthesize novel shapes, yet it remains unclear whether their generation relies on memorizing training shapes. Understanding their memorization could help prevent training data leakage and improve the diversity of generated results. In this paper, we design an evaluation framework to quantify memorization in 3D generative models and study the influence of different data and modeling designs on memorization. We first apply our framework to quantify memorization in existing methods. Next, through controlled experiments with a latent vector-set (Vecset) diffusion model, we find that, on the data side, memorization depends on data modality, and increases with data diversity and finer-grained conditioning; on the modeling side, it peaks at a moderate guidance scale and can be mitigated by longer Vecsets and simple rotation augmentation. Together, our framework and analysis provide an empirical understanding of memorization in 3D generative models and suggest simple yet effective strategies to reduce it without degrading generation quality. Our code is available at https://github.com/zlab-princeton/3d_mem.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 60 of its 73 references that are in the map. First posted on arXiv 29 Dec 2025.

Builds on

60 of 73 references.

References · 60

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 2022Classifier-Free Diffusion Guidancecited by 5,717
  6. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  7. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  8. 2016Understanding deep learning requires rethinking generalizationcited by 1,657
  9. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  10. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  11. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  12. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
38 more
  1. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  2. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  3. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  4. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  5. 2023Extracting Training Data from Diffusion Modelscited by 723
  6. 2020Implicit Geometric Regularization for Learning Shapescited by 707
  7. 2015Multi-view Convolutional Neural Networks for 3D Shape Recognitioncited by 564
  8. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
  9. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
  10. 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
  11. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 294
  12. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
  13. 20223D Neural Field Generation using Triplane Diffusioncited by 274
  14. 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 231
  15. 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
  16. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  17. 2023Understanding and Mitigating Copying in Diffusion Modelscited by 205
  18. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
  19. 2023Scalable 3D Captioning with Pretrained Modelscited by 201
  20. 2023ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understandingcited by 199
  21. 2023Generalization in diffusion models arises from geometry-adaptive harmonic representationscited by 179
  22. 2022A Self-Supervised Descriptor for Image Copy Detectioncited by 175
  23. 20193D Point Cloud Generative Adversarial Network Based on Tree Structured Graph Convolutionscited by 173
  24. 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 157
  25. 2020MVTN: Multi-View Transformation Network for 3D Shape Recognitioncited by 140
  26. 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
  27. 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 129
  28. 2023On Memorization in Diffusion Modelscited by 122
  29. 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 120
  30. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 113
  31. 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 103
  32. 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 100
  33. 2024Detecting, Explaining, and Mitigating Memorization in Diffusion Modelscited by 94
  34. 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoderscited by 93
  35. 20223DILG: Irregular Latent Grids for 3D Generative Modelingcited by 92
  36. 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
  37. 2018Data augmentation instead of explicit regularizationcited by 62
  38. 2025HoloPart: Generative 3D Part Amodal Segmentationcited by 57

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024A Geometric Framework for Understanding Memorization in Generative Models
  2. 2024Losing dimensions: Geometric memorization in generative diffusion
  3. 2025SolidMark: Evaluating Image Memorization in Generative Models
  4. 2025Evaluating Latent Generative Paradigms for High-Fidelity 3D Shape Completion from a Single Depth Image
  5. 2026The Null Is the Hard Part: Exact Tests for Memorization in Generative Models
  6. 2024Understanding and Mitigating Memorization in Generative Models via Sharpness of Probability Landscapes
  7. 2024Embedding Space Selection for Detecting Memorization and Fingerprinting in Generative Models
  8. 2022Deep Generative Models on 3D Representations: A Survey