mlsanityData to 7 Oct 2026

Order Matters: 3D Shape Generation from Sequential VR Sketches

arXiv 2512.04761 ↗First posted 4 Dec 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

VR sketching lets users explore and iterate on ideas directly in 3D, offering a faster and more intuitive alternative to conventional CAD tools. However, existing sketch-to-shape models ignore the temporal ordering of strokes, discarding crucial cues about structure and design intent. We introduce VRSketch2Shape, the first framework and multi-category dataset for generating 3D shapes from sequential VR sketches. Our contributions are threefold: (i) an automated pipeline that generates sequential VR sketches from arbitrary shapes, (ii) a dataset of over 20k synthetic and 900 hand-drawn sketch-shape pairs across four categories, and (iii) an order-aware sketch encoder coupled with a diffusion-based 3D generator. Our approach yields higher geometric fidelity than prior work, generalizes effectively from synthetic to real sketches with minimal supervision, and performs well even on partial sketches. All data and models will be released open-source at https://chenyizi086.github.io/VRSketch2Shape_website.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 63 of its 91 references that are in the map. First posted on arXiv 4 Dec 2025.

Builds on

63 of 91 references.

References · 63

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2017Neural Discrete Representation Learningcited by 4,650
  8. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  9. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  10. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  11. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  12. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
38 more
  1. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  2. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  3. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  4. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
  5. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  6. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  7. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  8. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  9. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
  10. 2017A Neural Representation of Sketch Drawingscited by 311
  11. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
  12. 2019What Do Single-view 3D Reconstruction Networks Learn?cited by 259
  13. 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
  14. 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
  15. 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 198
  16. 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 129
  17. 2022ShapeFormer: Transformer-based Shape Completion via Sparse Representationcited by 106
  18. 2024BrepGen: A B-rep Generative Diffusion Model with Structured Latent Geometrycited by 101
  19. 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoderscited by 93
  20. 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
  21. 2019Photo-Sketching: Inferring Contour Drawings from Imagescited by 67
  22. 20223D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Modelscited by 67
  23. 2022CLIPascene: Scene Sketching with Different Types and Levels of Abstractioncited by 63
  24. 2023IT3D: Improved Text-to-3D Generation with Explicit View Synthesiscited by 63
  25. 2022ShapeCrafter: A Recursive Text-Conditioned 3D Shape Generation Modelcited by 62
  26. 2020Multimodal Shape Completion via Conditional Generative Adversarial Networkscited by 61
  27. 2021Sketch2Model: View-Aware 3D Modeling from Single Free-Hand Sketchescited by 54
  28. 2023DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion Modelscited by 54
  29. 2021Sketch2Mesh: Reconstructing and Editing 3D Shapes from Sketchescited by 50
  30. 2018Learning to Sketch with Shortcut Cycle Consistencycited by 47
  31. 20173D Shape Reconstruction from Sketches via Multi-view Convolutional Networkscited by 44
  32. 2020Sketch-BERT: Learning Sketch Bidirectional Encoder Representation from Transformers by Self-supervised Learning of Sketch Gestaltcited by 42
  33. 20173D Sketching using Multi-View Deep Volumetric Predictioncited by 36
  34. 2023Point2CAD: Reverse Engineering CAD Models from 3D Point Cloudscited by 33
  35. 2022A Sketch Is Worth a Thousand Words: Image Retrieval with Text and Sketchcited by 28
  36. 2022Cross-Modal 3D Shape Generation and Manipulationcited by 27
  37. 20243Doodle: Compact Abstraction of Objects with 3D Strokescited by 21
  38. 20203D Shape Reconstruction from Free-Hand Sketchescited by 20

50 most cited of 63 All 63 (JSON)

Built on by

Not cited yet.