mlsanityData to 7 Oct 2026

PointNSP: Autoregressive 3D Point Cloud Generation with Next-Scale Level-of-Detail Prediction

arXiv 2510.05613 ↗First posted 7 Oct 2025cs.CV cs.AI cs.LGcited by 9

Not on the map. Why?

Abstract (arXiv)

Autoregressive point cloud generation has long lagged behind diffusion-based approaches in quality. The performance gap stems from the fact that autoregressive models impose an artificial ordering on inherently unordered point sets, forcing shape generation to proceed as a sequence of local predictions. This sequential bias emphasizes short-range continuity but undermines the model's capacity to capture long-range dependencies, hindering its ability to enforce global structural properties such as symmetry, consistent topology, and large-scale geometric regularities. Inspired by the level-of-detail (LOD) principle in shape modeling, we propose PointNSP, a coarse-to-fine generative framework that preserves global shape structure at low resolutions and progressively refines fine-grained geometry at higher scales through a next-scale prediction paradigm. This multi-scale factorization aligns the autoregressive objective with the permutation-invariant nature of point sets, enabling rich intra-scale interactions while avoiding brittle fixed orderings. Experiments on ShapeNet show that PointNSP establishes state-of-the-art (SOTA) generation quality for the first time within the autoregressive paradigm. In addition, it surpasses strong diffusion-based baselines in parameter, training, and inference efficiency. Finally, in dense generation with 8,192 points, PointNSP's advantages become even more pronounced, underscoring its scalability potential.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 70 of its 79 references that are in the map. First posted on arXiv 7 Oct 2025.

Builds on

70 of 79 references.

References · 70

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2024The Llama 3 Herd of Modelscited by 14,192
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  7. 2022Flow Matching for Generative Modelingcited by 5,426
  8. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  9. 2017Neural Discrete Representation Learningcited by 4,650
  10. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  11. 2018Neural Ordinary Differential Equationscited by 3,733
  12. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
38 more
  1. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  2. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  3. 2015Variational Inference with Normalizing Flowscited by 2,161
  4. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  5. 2020Point Transformercited by 1,462
  6. 2017Deep Setscited by 1,394
  7. 2022MaskGIT: Masked Generative Image Transformercited by 1,082
  8. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
  9. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
  10. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
  11. 2022Autoregressive Image Generation using Residual Quantizationcited by 706
  12. 2024Autoregressive Image Generation without Vector Quantizationcited by 644
  13. 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 584
  14. 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
  15. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
  16. 2023SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilitiescited by 518
  17. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  18. 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 487
  19. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
  20. 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 432
  21. 2018GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Modelscited by 406
  22. 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 384
  23. 2019Point-Voxel CNN for Efficient 3D Deep Learningcited by 343
  24. 2020GraphAF: a Flow-based Autoregressive Model for Molecular Graph Generationcited by 301
  25. 2016Revisiting Classifier Two-Sample Testscited by 258
  26. 2020Learning Gradient Fields for Shape Generationcited by 245
  27. 2018Molecular Transformer - A Model for Uncertainty-Calibrated Chemical Reaction Predictioncited by 225
  28. 2018PU-Net: Point Cloud Upsampling Networkcited by 208
  29. 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
  30. 2019Scaling Autoregressive Video Modelscited by 189
  31. 20193D Point Cloud Generative Adversarial Network Based on Tree Structured Graph Convolutionscited by 173
  32. 2019PU-GAN: a Point Cloud Upsampling Adversarial Networkcited by 162
  33. 2023PointGPT: Auto-regressively Generative Pre-training from Point Cloudscited by 115
  34. 2023DiT-3D: Exploring Plain Diffusion Transformers for 3D Shape Generationcited by 110
  35. 2022ShapeFormer: Transformer-based Shape Completion via Sparse Representationcited by 106
  36. 2018PointGrow: Autoregressively Learned Point Cloud Generation with Self-Attentioncited by 105
  37. 2019PU-GCN: Point Cloud Upsampling using Graph Convolutional Networkscited by 100
  38. 2020SoftFlow: Probabilistic Framework for Normalizing Flow on Manifoldscited by 97

50 most cited of 70 All 70 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 8.

9 papers.