Memorization in 3D Shape Generation: An Empirical Study
Not on the map. Why?
Abstract (arXiv)
Generative models are increasingly used in 3D vision to synthesize novel shapes, yet it remains unclear whether their generation relies on memorizing training shapes. Understanding their memorization could help prevent training data leakage and improve the diversity of generated results. In this paper, we design an evaluation framework to quantify memorization in 3D generative models and study the influence of different data and modeling designs on memorization. We first apply our framework to quantify memorization in existing methods. Next, through controlled experiments with a latent vector-set (Vecset) diffusion model, we find that, on the data side, memorization depends on data modality, and increases with data diversity and finer-grained conditioning; on the modeling side, it peaks at a moderate guidance scale and can be mitigated by longer Vecsets and simple rotation augmentation. Together, our framework and analysis provide an empirical understanding of memorization in 3D generative models and suggest simple yet effective strategies to reduce it without degrading generation quality. Our code is available at https://github.com/zlab-princeton/3d_mem.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 60 of its 73 references that are in the map. First posted on arXiv 29 Dec 2025.
Builds on
60 of 73 references.
References · 60
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2016Understanding deep learning requires rethinking generalizationcited by 1,657
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
38 more
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2023Extracting Training Data from Diffusion Modelscited by 723
- 2020Implicit Geometric Regularization for Learning Shapescited by 707
- 2015Multi-view Convolutional Neural Networks for 3D Shape Recognitioncited by 564
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
- 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 294
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 231
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
- 2023Understanding and Mitigating Copying in Diffusion Modelscited by 205
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
- 2023Scalable 3D Captioning with Pretrained Modelscited by 201
- 2023ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understandingcited by 199
- 2023Generalization in diffusion models arises from geometry-adaptive harmonic representationscited by 179
- 2022A Self-Supervised Descriptor for Image Copy Detectioncited by 175
- 20193D Point Cloud Generative Adversarial Network Based on Tree Structured Graph Convolutionscited by 173
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 157
- 2020MVTN: Multi-View Transformation Network for 3D Shape Recognitioncited by 140
- 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
- 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 129
- 2023On Memorization in Diffusion Modelscited by 122
- 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 120
- 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 113
- 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 103
- 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 100
- 2024Detecting, Explaining, and Mitigating Memorization in Diffusion Modelscited by 94
- 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoderscited by 93
- 20223DILG: Irregular Latent Grids for 3D Generative Modelingcited by 92
- 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
- 2018Data augmentation instead of explicit regularizationcited by 62
- 2025HoloPart: Generative 3D Part Amodal Segmentationcited by 57
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024A Geometric Framework for Understanding Memorization in Generative Models
- 2024Losing dimensions: Geometric memorization in generative diffusion
- 2025SolidMark: Evaluating Image Memorization in Generative Models
- 2025Evaluating Latent Generative Paradigms for High-Fidelity 3D Shape Completion from a Single Depth Image
- 2026The Null Is the Hard Part: Exact Tests for Memorization in Generative Models
- 2024Understanding and Mitigating Memorization in Generative Models via Sharpness of Probability Landscapes
- 2024Embedding Space Selection for Detecting Memorization and Fingerprinting in Generative Models
- 2022Deep Generative Models on 3D Representations: A Survey