Interactive Sketching of Mannequin Poses
Not on the map. Why?
Abstract (arXiv)
It can be easy and even fun to sketch humans in different poses. In contrast, creating those same poses on a 3D graphics "mannequin" is comparatively tedious. Yet 3D body poses are necessary for various downstream applications. We seek to preserve the convenience of 2D sketching while giving users of different skill levels the flexibility to accurately and more quickly poseslash refine a 3D mannequin. At the core of the interactive system, we propose a machine-learning model for inferring the 3D pose of a CG mannequin from sketches of humans drawn in a cylinder-person style. Training such a model is challenging because of artist variability, a lack of sketch training data with corresponding ground truth 3D poses, and the high dimensionality of human pose-space. Our unique approach to synthesizing vector graphics training data underpins our integrated ML-and-kinematics system. We validate the system by tightly coupling it with a user interface, and by performing a user study, in addition to quantitative comparisons.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 18 of its 58 references that are in the map. First posted on arXiv 14 Dec 2022.
Builds on
18 of 58 references.
References · 18
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2017Mask R-CNNcited by 7,259
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
- 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 493
- 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 417
- 2018Neural Body Fitting: Unifying Deep Learning and Model-Based Human Pose and Shape Estimationcited by 185
- 2020Synthetic Training for Accurate 3D Human Pose and Shape Estimation in the Wildcited by 82
- 20173D Shape Reconstruction from Sketches via Multi-view Convolutional Networkscited by 44
- 20173D Sketching using Multi-View Deep Volumetric Predictioncited by 36
6 more
- 2020SkeletonNet: A Topology-Preserving Solution for Learning Mesh Reconstruction of Object Surfaces from RGB Imagescited by 30
- 2020P-Cloth: Interactive Complex Cloth Simulation on Multi-GPU Systems using Dynamic Matrix Assembly and Pipelined Implicit Integratorscited by 26
- 20203D Reconstruction of Novel Object Shapes from Single Imagescited by 21
- 20203D Shape Reconstruction from Free-Hand Sketchescited by 20
- 2020Neural Contours: Learning to Draw Lines from 3D Shapescited by 15
- 2020Deep Sketch-Based Modeling: Tips and Trickscited by 15
Built on by
Citing papers per year: 2023: 2; 2024: 1.
3 papers.