PointNSP: Autoregressive 3D Point Cloud Generation with Next-Scale Level-of-Detail Prediction
Not on the map. Why?
Abstract (arXiv)
Autoregressive point cloud generation has long lagged behind diffusion-based approaches in quality. The performance gap stems from the fact that autoregressive models impose an artificial ordering on inherently unordered point sets, forcing shape generation to proceed as a sequence of local predictions. This sequential bias emphasizes short-range continuity but undermines the model's capacity to capture long-range dependencies, hindering its ability to enforce global structural properties such as symmetry, consistent topology, and large-scale geometric regularities. Inspired by the level-of-detail (LOD) principle in shape modeling, we propose PointNSP, a coarse-to-fine generative framework that preserves global shape structure at low resolutions and progressively refines fine-grained geometry at higher scales through a next-scale prediction paradigm. This multi-scale factorization aligns the autoregressive objective with the permutation-invariant nature of point sets, enabling rich intra-scale interactions while avoiding brittle fixed orderings. Experiments on ShapeNet show that PointNSP establishes state-of-the-art (SOTA) generation quality for the first time within the autoregressive paradigm. In addition, it surpasses strong diffusion-based baselines in parameter, training, and inference efficiency. Finally, in dense generation with 8,192 points, PointNSP's advantages become even more pronounced, underscoring its scalability potential.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 70 of its 79 references that are in the map. First posted on arXiv 7 Oct 2025.
Builds on
70 of 79 references.
References · 70
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017Neural Discrete Representation Learningcited by 4,650
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
38 more
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2020Point Transformercited by 1,462
- 2017Deep Setscited by 1,394
- 2022MaskGIT: Masked Generative Image Transformercited by 1,082
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
- 2022Autoregressive Image Generation using Residual Quantizationcited by 706
- 2024Autoregressive Image Generation without Vector Quantizationcited by 644
- 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 584
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
- 2023SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilitiescited by 518
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 487
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
- 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 432
- 2018GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Modelscited by 406
- 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 384
- 2019Point-Voxel CNN for Efficient 3D Deep Learningcited by 343
- 2020GraphAF: a Flow-based Autoregressive Model for Molecular Graph Generationcited by 301
- 2016Revisiting Classifier Two-Sample Testscited by 258
- 2020Learning Gradient Fields for Shape Generationcited by 245
- 2018Molecular Transformer - A Model for Uncertainty-Calibrated Chemical Reaction Predictioncited by 225
- 2018PU-Net: Point Cloud Upsampling Networkcited by 208
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
- 2019Scaling Autoregressive Video Modelscited by 189
- 20193D Point Cloud Generative Adversarial Network Based on Tree Structured Graph Convolutionscited by 173
- 2019PU-GAN: a Point Cloud Upsampling Adversarial Networkcited by 162
- 2023PointGPT: Auto-regressively Generative Pre-training from Point Cloudscited by 115
- 2023DiT-3D: Exploring Plain Diffusion Transformers for 3D Shape Generationcited by 110
- 2022ShapeFormer: Transformer-based Shape Completion via Sparse Representationcited by 106
- 2018PointGrow: Autoregressively Learned Point Cloud Generation with Self-Attentioncited by 105
- 2019PU-GCN: Point Cloud Upsampling using Graph Convolutional Networkscited by 100
- 2020SoftFlow: Probabilistic Framework for Normalizing Flow on Manifoldscited by 97
50 most cited of 70 All 70 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 8.
9 papers.
- 2025Range-Edit: Semantic Mask Guided Outdoor LiDAR Scene Editingcited by 1
- 2026Block3D: Efficient Text-to-3D Generation via Block-Wise Diffusioncited by 1
- 2026ARGS: Auto-Regressive Gaussian Splatting via Parallel Progressive Next-Scale Predictioncited by 0
- 2026A Few-Step Generative Model on Cumulative Flow Mapscited by 0
- 2026Invaria: Learning Scale and Density Invariance in Point Clouds via Next-Resolution Predictioncited by 0
- 2026FPSGen: Flexible Point Cloud Scene Generation with BEV-Supported Transport Flowscited by 0
- 2026Learning to Tessellate: Point Cloud Generation via Recursive Spectral Partitioningcited by 0
- 2026Hierarchical Flow Matching for 3D Point Cloud Generationcited by 0
- 2026MeshOctave: Vertex Split-and-Rewire Cascades for Native Mesh Generationcited by 0
- 2026MeshOctave: Vertex Split-and-Rewire Cascades for Native Mesh Generation30 Sep 2026
- 2026Block3D: Efficient Text-to-3D Generation via Block-Wise Diffusion20 Aug 2026
- 2026Hierarchical Flow Matching for 3D Point Cloud Generation6 Aug 2026
- 2026Learning to Tessellate: Point Cloud Generation via Recursive Spectral Partitioning3 Aug 2026
- 2026FPSGen: Flexible Point Cloud Scene Generation with BEV-Supported Transport Flows29 Jul 2026
- 2026Invaria: Learning Scale and Density Invariance in Point Clouds via Next-Resolution Prediction15 May 2026
- 2026A Few-Step Generative Model on Cumulative Flow Maps5 May 2026
- 2026ARGS: Auto-Regressive Gaussian Splatting via Parallel Progressive Next-Scale Prediction1 Apr 2026
- 2025Range-Edit: Semantic Mask Guided Outdoor LiDAR Scene Editing21 Nov 2025