3Doodle: Compact Abstraction of Objects with 3D Strokes
Not on the map. Why?
Abstract (arXiv)
While free-hand sketching has long served as an efficient representation to convey characteristics of an object, they are often subjective, deviating significantly from realistic representations. Moreover, sketches are not consistent for arbitrary viewpoints, making it hard to catch 3D shapes. We propose 3Dooole, generating descriptive and view-consistent sketch images given multi-view images of the target object. Our method is based on the idea that a set of 3D strokes can efficiently represent 3D structural information and render view-consistent 2D sketches. We express 2D sketches as a union of view-independent and view-dependent components. 3D cubic B ezier curves indicate view-independent 3D feature lines, while contours of superquadrics express a smooth outline of the volume of varying viewpoints. Our pipeline directly optimizes the parameters of 3D stroke primitives to minimize perceptual losses in a fully differentiable manner. The resulting sparse set of 3D strokes can be rendered as abstract sketches containing essential 3D characteristic shapes of various objects. We demonstrate that 3Doodle can faithfully express concepts of the original images compared with recent sketch generation approaches.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 34 of its 62 references that are in the map. First posted on arXiv 6 Feb 2024.
Builds on
34 of 62 references.
References · 34
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
22 more
- 2017A Neural Representation of Sketch Drawingscited by 311
- 2017A General and Adaptive Robust Loss Functioncited by 236
- 2021Pixel Difference Networks for Efficient Edge Detectioncited by 167
- 2022Modeling Indirect Illumination for Inverse Renderingcited by 167
- 2022ARF: Artistic Radiance Fieldscited by 147
- 2019Superquadrics Revisited: Learning 3D Shape Parsing beyond Cuboidscited by 123
- 2022Voxurf: Voxel-based Efficient and Accurate Neural Surface Reconstructioncited by 92
- 2023SKED: Sketch-guided Text-based 3D Editingcited by 72
- 2022CLIPasso: Semantically-Aware Object Sketchingcited by 57
- 2021Sketch2Model: View-Aware 3D Modeling from Single Free-Hand Sketchescited by 54
- 2021Sketch2Mesh: Reconstructing and Editing 3D Shapes from Sketchescited by 50
- 2018Learning to Sketch with Shortcut Cycle Consistencycited by 47
- 2022Ref-NPR: Reference-Based Non-Photorealistic Radiance Fields for Controllable Scene Stylizationcited by 35
- 2021SketchEdit: Mask-Free Local Image Manipulation with Partial Sketchescited by 32
- 2023NEF: Neural Edge Fields for 3D Parametric Curve Reconstruction from Multi-view Imagescited by 22
- 2020Neural Contours: Learning to Draw Lines from 3D Shapescited by 15
- 2023Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D Shapescited by 14
- 2020Synthesizing human-like sketches from natural images using a conditional convolutional decodercited by 13
- 2021Neural Strokes: Stylized Line Drawing of 3D Shapescited by 13
- 2023Iterative Superquadric Recomposition of 3D Objects from Multiple Viewscited by 13
- 2018Line Drawings from 3D Modelscited by 7
- 2022Fine-Grained VR Sketching: Dataset and Insightscited by 5
Built on by
Citing papers per year: 2024: 3; 2025: 9; 2026: 9.
21 papers.
Sort:
- 2024SketchAgent: Language-Driven Sequential Sketch Generationcited by 30
- 2024Diff3DS: Generating View-Consistent 3D Sketch via Differentiable Curve Renderingcited by 9
- 2025Curve-Aware Gaussian Splatting for 3D Parametric Curve Reconstructioncited by 9
- 2024FlipSketch: Flipping Static Drawings to Text-Guided Sketch Animationscited by 8
- 2025SketchSplat: 3D Edge Reconstruction via Differentiable Multi-view Sketch Splattingcited by 5
- 2025ViewCraft3D: High-Fidelity and View-Consistent 3D Vector Graphics Synthesiscited by 5
- 2025WIR3D: Visually-Informed and Geometry-Aware 3D Shape Abstractioncited by 3
- 2026Deep Sketch-Based 3D Modeling: A Surveycited by 3
- 2025Recovering Dynamic 3D Sketches from Videoscited by 2
- 2025Empowering Vector Graphics with Consistently Arbitrary Viewing and View-dependent Visibilitycited by 1
- 20263DrawAgent: Teaching LLM to Draw in 3D with Early Contrastive Experiencecited by 1
- 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learningcited by 1
9 more
- 20254-Doodle: Text to 3D Sketches that Move!cited by 0
- 2025SVG360: Editable Multiview Vector Graphics from a Single SVGcited by 0
- 2025Order Matters: 3D Shape Generation from Sequential VR Sketchescited by 0
- 2026RoEL: Robust Event-based 3D Line Reconstructioncited by 0
- 2026Optimizing 4D Wires for Sparse 3D Abstractioncited by 0
- 2026A Holistic Method for Superquadric Fitting Using Unsupervised Clustering Analysiscited by 0
- 2026Single-Line Drawing Generation via Semantics-Driven Optimizationcited by 0
- 2026Inverse Rendering for Modeling with Line Primitivescited by 0
- 2026CGGT: Curve-Grounded Geometry Transformer for 3D Parametric Curve Reconstructioncited by 0
- 2026CGGT: Curve-Grounded Geometry Transformer for 3D Parametric Curve Reconstruction13 Sep 2026
- 2026Inverse Rendering for Modeling with Line Primitives1 Sep 2026
- 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learning8 Jul 2026
- 2026Single-Line Drawing Generation via Semantics-Driven Optimization1 Jun 2026
- 2026A Holistic Method for Superquadric Fitting Using Unsupervised Clustering Analysis16 May 2026
- 2026Optimizing 4D Wires for Sparse 3D Abstraction12 May 2026
- 20263DrawAgent: Teaching LLM to Draw in 3D with Early Contrastive Experience9 Apr 2026
- 2026RoEL: Robust Event-based 3D Line Reconstruction20 Feb 2026
- 2026Deep Sketch-Based 3D Modeling: A Survey22 Jan 2026
- 2025Order Matters: 3D Shape Generation from Sequential VR Sketches4 Dec 2025
- 2025SVG360: Editable Multiview Vector Graphics from a Single SVG20 Nov 2025
- 20254-Doodle: Text to 3D Sketches that Move!29 Oct 2025
9 more
- 2025Curve-Aware Gaussian Splatting for 3D Parametric Curve Reconstruction26 Jun 2025
- 2025Empowering Vector Graphics with Consistently Arbitrary Viewing and View-dependent Visibility27 May 2025
- 2025ViewCraft3D: High-Fidelity and View-Consistent 3D Vector Graphics Synthesis26 May 2025
- 2025WIR3D: Visually-Informed and Geometry-Aware 3D Shape Abstraction7 May 2025
- 2025Recovering Dynamic 3D Sketches from Videos26 Mar 2025
- 2025SketchSplat: 3D Edge Reconstruction via Differentiable Multi-view Sketch Splatting18 Mar 2025
- 2024SketchAgent: Language-Driven Sequential Sketch Generation26 Nov 2024
- 2024FlipSketch: Flipping Static Drawings to Text-Guided Sketch Animations16 Nov 2024
- 2024Diff3DS: Generating View-Consistent 3D Sketch via Differentiable Curve Rendering24 May 2024
- 2024SketchAgent: Language-Driven Sequential Sketch Generationcited by 30
- 2024Diff3DS: Generating View-Consistent 3D Sketch via Differentiable Curve Renderingcited by 9
- 2025Curve-Aware Gaussian Splatting for 3D Parametric Curve Reconstructioncited by 9
- 2024FlipSketch: Flipping Static Drawings to Text-Guided Sketch Animationscited by 8
- 2025SketchSplat: 3D Edge Reconstruction via Differentiable Multi-view Sketch Splattingcited by 5
- 2025ViewCraft3D: High-Fidelity and View-Consistent 3D Vector Graphics Synthesiscited by 5
- 2025WIR3D: Visually-Informed and Geometry-Aware 3D Shape Abstractioncited by 3
- 2026Deep Sketch-Based 3D Modeling: A Surveycited by 3
- 2025Recovering Dynamic 3D Sketches from Videoscited by 2
- 2025Empowering Vector Graphics with Consistently Arbitrary Viewing and View-dependent Visibilitycited by 1
- 20263DrawAgent: Teaching LLM to Draw in 3D with Early Contrastive Experiencecited by 1
- 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learningcited by 1
12 most cited of 21 All 21 (JSON)
- 2026CGGT: Curve-Grounded Geometry Transformer for 3D Parametric Curve Reconstruction13 Sep 2026
- 2026Inverse Rendering for Modeling with Line Primitives1 Sep 2026
- 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learning8 Jul 2026
- 2026Single-Line Drawing Generation via Semantics-Driven Optimization1 Jun 2026
- 2026A Holistic Method for Superquadric Fitting Using Unsupervised Clustering Analysis16 May 2026
- 2026Optimizing 4D Wires for Sparse 3D Abstraction12 May 2026
- 20263DrawAgent: Teaching LLM to Draw in 3D with Early Contrastive Experience9 Apr 2026
- 2026RoEL: Robust Event-based 3D Line Reconstruction20 Feb 2026
- 2026Deep Sketch-Based 3D Modeling: A Survey22 Jan 2026
- 2025Order Matters: 3D Shape Generation from Sequential VR Sketches4 Dec 2025
- 2025SVG360: Editable Multiview Vector Graphics from a Single SVG20 Nov 2025
- 20254-Doodle: Text to 3D Sketches that Move!29 Oct 2025
12 newest of 21 All 21 (JSON)