mlsanityData to 7 Oct 2026

Fine-Grained VR Sketching: Dataset and Insights

arXiv 2209.10008 ↗First posted 20 Sep 2022cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

We present the first fine-grained dataset of 1,497 3D VR sketch and 3D shape pairs of a chair category with large shapes diversity. Our dataset supports the recent trend in the sketch community on fine-grained data analysis, and extends it to an actively developing 3D domain. We argue for the most convenient sketching scenario where the sketch consists of sparse lines and does not require any sketching skills, prior training or time-consuming accurate drawing. We then, for the first time, study the scenario of fine-grained 3D VR sketch to 3D shape retrieval, as a novel VR sketching application and a proving ground to drive out generic insights to inform future research. By experimenting with carefully selected combinations of design factors on this new problem, we draw important conclusions to help follow-on work. We hope our dataset will enable other novel applications, especially those that require a fine-grained angle such as fine-grained 3D shape reconstruction. The dataset is available at tinyurl.com/VRSketch3DV21.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 49 of its 89 references that are in the map. First posted on arXiv 20 Sep 2022.

Builds on

49 of 89 references.

References · 49

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  4. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  5. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  6. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  7. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  8. 2020Supervised Contrastive Learningcited by 2,803
  9. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  10. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
  11. 2018PointCNN: Convolution On X-Transformed Pointscited by 764
  12. 2019Data-Efficient Image Recognition with Contrastive Predictive Codingcited by 672
37 more
  1. 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 487
  2. 2018PCN: Point Completion Networkcited by 382
  3. 2017A Neural Representation of Sketch Drawingscited by 311
  4. 2016Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesiscited by 219
  5. 2014Learning Fine-grained Image Similarity with Deep Rankingcited by 189
  6. 2018PPFNet: Global Context Aware Local Features for Robust 3D Point Matchingcited by 180
  7. 20193D Point Cloud Generative Adversarial Network Based on Tree Structured Graph Convolutionscited by 173
  8. 2019PU-GAN: a Point Cloud Upsampling Adversarial Networkcited by 162
  9. 2018Point Convolutional Neural Networks by Extension Operatorscited by 154
  10. 2018Scan2CAD: Learning CAD Model Alignment in RGB-D Scanscited by 142
  11. 2020Cascaded Refinement Network for Point Cloud Completioncited by 112
  12. 2018PointGrow: Autoregressively Learned Point Cloud Generation with Self-Attentioncited by 105
  13. 2017ScanComplete: Large-Scale Scene Completion and Semantic Segmentation for 3D Scanscited by 103
  14. 2019PointCleanNet: Learning to Denoise and Remove Outliers from Dense Point Cloudscited by 99
  15. 2017PCPNET: Learning Local Shape Properties from Raw Point Cloudscited by 97
  16. 2020SoftFlow: Probabilistic Framework for Normalizing Flow on Manifoldscited by 97
  17. 2018Multiresolution Tree Networks for 3D Point Cloud Processingcited by 91
  18. 2018Point Cloud GANcited by 79
  19. 2018Triplet-Center Loss for Multi-View 3D Object Retrievalcited by 69
  20. 2020Sketch Less for More: On-the-Fly Fine-Grained Sketch Based Image Retrievalcited by 59
  21. 2019C-Flow: Conditional Generative Flow Models for Images and 3D Point Cloudscited by 50
  22. 2018Nesti-Net: Normal Estimation for Unstructured 3D Point Clouds using Convolutional Neural Networkscited by 44
  23. 2015Sketch-based 3D Shape Retrieval using Convolutional Neural Networkscited by 41
  24. 2020ManifoldPlus: A Robust and Scalable Watertight Manifold Surface Generation Method for Triangle Soupscited by 38
  25. 2020Deep Feature-preserving Normal Estimation for Point Cloud Filteringcited by 36
  26. 2018SketchyScene: Richly-Annotated Scene Sketchescited by 32
  27. 20183D Pose Estimation and 3D Model Retrieval for Objects in the Wildcited by 31
  28. 2020Deformation-Aware 3D Model Embedding and Retrievalcited by 30
  29. 2019Joint Embedding of 3D Scan and CAD Objectscited by 19
  30. 2019View N-gram Network for 3D Object Retrievalcited by 18
  31. 2020Deep Sketch-Based Modeling: Tips and Trickscited by 15
  32. 2017Rethinking Feature Discrimination and Polymerization for Large-scale Recognitioncited by 13
  33. 2018Angular Triplet-Center Loss for Multi-view 3D Shape Retrievalcited by 11
  34. 2020Semantically Tied Paired Cycle Consistency for Any-Shot Sketch-based Image Retrievalcited by 10
  35. 2020Rethinking Sampling in 3D Point Cloud Generative Adversarial Networkscited by 7
  36. 2017Shape Generation using Spatially Partitioned Point Cloudscited by 1
  37. 2019Rethinking Loss Design for Large-scale 3D Shape Retrievalcited by 1

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 1; 2025: 2.

5 papers.

  1. 20243Doodle: Compact Abstraction of Objects with 3D Strokescited by 21
  2. 20233D VR Sketch Guided 3D Shape Prototyping and Explorationcited by 12
  3. 2023Fine-Tuned but Zero-Shot 3D Shape Sketch View Similarity and Retrievalcited by 3
  4. 2025From Air to Wear: Personalized 3D Digital Fashion with AR/VR Immersive 3D Sketchingcited by 1
  5. 2025Order Matters: 3D Shape Generation from Sequential VR Sketchescited by 0