mlsanityData to 7 Oct 2026

4-Doodle: Text to 3D Sketches that Move!

arXiv 2510.25319 ↗First posted 29 Oct 2025cs.GR cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We present a novel task: text-to-3D sketch animation, which aims to bring freeform sketches to life in dynamic 3D space. Unlike prior works focused on photorealistic content generation, we target sparse, stylized, and view-consistent 3D vector sketches, a lightweight and interpretable medium well-suited for visual communication and prototyping. However, this task is very challenging: (i) no paired dataset exists for text and 3D (or 4D) sketches; (ii) sketches require structural abstraction that is difficult to model with conventional 3D representations like NeRFs or point clouds; and (iii) animating such sketches demands temporal coherence and multi-view consistency, which current pipelines do not address. Therefore, we propose 4-Doodle, the first training-free framework for generating dynamic 3D sketches from text. It leverages pretrained image and video diffusion models through a dual-space distillation scheme: one space captures multi-view-consistent geometry using differentiable B'ezier curves, while the other encodes motion dynamics via temporally-aware priors. Unlike prior work (e.g., DreamFusion), which optimizes from a single view per step, our multi-view optimization ensures structural alignment and avoids view ambiguity, critical for sparse sketches. Furthermore, we introduce a structure-aware motion module that separates shape-preserving trajectories from deformation-aware changes, enabling expressive motion such as flipping, rotation, and articulated movement. Extensive experiments show that our method produces temporally realistic and structurally stable 3D sketch animations, outperforming existing baselines in both fidelity and controllability. We hope this work serves as a step toward more intuitive and accessible 4D content creation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 30 references that are in the map. First posted on arXiv 29 Oct 2025.

Builds on

22 of 30 references.

References · 22

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  6. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  8. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  9. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  10. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 568
  11. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
  12. 2023Text-To-4D Dynamic Scene Generationcited by 204
10 more
  1. 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 184
  2. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  3. 20243DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priorscited by 72
  4. 2024Animate3D: Animating Any 3D Model with Multi-view Video Diffusioncited by 55
  5. 2023DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion Modelscited by 54
  6. 2023Breathing Life Into Sketches Using Text-to-Video Priorscited by 47
  7. 2019Learning Temporal Pose Estimation from Sparsely-Labeled Videoscited by 39
  8. 20243Doodle: Compact Abstraction of Objects with 3D Strokescited by 21
  9. 2025Sketch2Anim: Towards Transferring Sketch Storyboards into 3D Animationcited by 16
  10. 2024Diff3DS: Generating View-Consistent 3D Sketch via Differentiable Curve Renderingcited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Enhancing Sketch Animation: Text-to-Video Diffusion Models with Temporal Consistency and Rigidity Constraints
  2. 2024Sketch2NeRF: Multi-view Sketch-guided Text-to-3D Generation
  3. 2024SketchDream: Sketch-based Text-to-3D Generation and Editing
  4. 2026Sketch2Motion: Text-driven 2D Sketch to 3D Animation via Diffusion-guided Skeleton Optimization
  5. 2023Control3D: Towards Controllable Text-to-3D Generation
  6. 20263DrawAgent: Teaching LLM to Draw in 3D with Early Contrastive Experience
  7. 2025AnimateAnyMesh: A Feed-Forward 4D Foundation Model for Text-Driven Universal Mesh Animation
  8. 2024FlipSketch: Flipping Static Drawings to Text-Guided Sketch Animations