mlsanityData to 7 Oct 2026

DRiVE: Diffusion-based Rigging Empowers Generation of Versatile and Expressive Characters

arXiv 2411.17423 ↗First posted 26 Nov 2024cs.CVcited by 24

Not on the map. Why?

Abstract (arXiv)

Recent advances in generative models have enabled high-quality 3D character reconstruction from multi-modal. However, animating these generated characters remains a challenging task, especially for complex elements like garments and hair, due to the lack of large-scale datasets and effective rigging methods. To address this gap, we curate AnimeRig, a large-scale dataset with detailed skeleton and skinning annotations. Building upon this, we propose DRiVE, a novel framework for generating and rigging 3D human characters with intricate structures. Unlike existing methods, DRiVE utilizes a 3D Gaussian representation, facilitating efficient animation and high-quality rendering. We further introduce GSDiff, a 3D Gaussian-based diffusion module that predicts joint positions as spatial distributions, overcoming the limitations of regression-based approaches. Extensive experiments demonstrate that DRiVE achieves precise rigging results, enabling realistic dynamics for clothing and hair, and surpassing previous methods in both quality and versatility. The code and dataset will be made public for academic use upon acceptance.

Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 67 of its 84 references that are in the map. First posted on arXiv 26 Nov 2024.

Builds on

67 of 84 references.

References · 67

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  5. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  7. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  8. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  9. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  10. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  11. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  12. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
38 more
  1. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
  2. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
  3. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  4. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  5. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  6. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  7. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  8. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  9. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  10. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  11. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  12. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  13. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
  14. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
  15. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
  16. 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 384
  17. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  18. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  19. 2016Convolutional Pose Machinescited by 325
  20. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
  21. 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
  22. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 256
  23. 2017Hand Keypoint Detection in Single Images using Multiview Bootstrappingcited by 231
  24. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 227
  25. 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
  26. 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 195
  27. 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 190
  28. 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 171
  29. 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
  30. 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
  31. 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Imagecited by 132
  32. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 122
  33. 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 120
  34. 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
  35. 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 99
  36. 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
  37. 2023HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generationcited by 88
  38. 2023PC2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstructioncited by 84

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 10; 2026: 14.

24 papers.

Sort:

By area:

  1. 2025Puppeteer: Rig and Animate Your 3D Modelscited by 41
  2. 2025GAS: Generative Avatar Synthesis from a Single Imagecited by 19
  3. 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 18
  4. 2025SIGMAN:Scaling 3D Human Gaussian Generation with Millions of Assetscited by 12
  5. 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generationcited by 12
  6. 2025Auto-Connect: Connectivity-Preserving RigFormer with Direct Preference Optimizationcited by 7
  7. 2026HVG-3D: Bridging Real and Simulation Domains for 3D-Conditional Hand-Object Interaction Video Synthesiscited by 7
  8. 2026Skin Tokens: A Learned Compact Representation for Unified Autoregressive Riggingcited by 5
  9. 2026LottieGPT: Tokenizing Vector Animation for Autoregressive Generationcited by 5
  10. 2025ARMO: Autoregressive Rigging for Multi-Category Objectscited by 4
  11. 2025LLMsPark: A Benchmark for Evaluating Large Language Models in Strategic Gaming Contextscited by 4
  12. 2026AniGen: Unified S3 Fields for Animatable 3D Asset Generationcited by 3
12 more
  1. 2026Engine-Native Editable 3D World Reconstruction with Objects and Lightingcited by 3
  2. 2026One Video, One World: Turning Monocular Video into Physical 4D Scenescited by 2
  3. 2026PairCoder++: Pair Programming as a Universal Paradigm for Verified Code-Driven Multimodal and Structured-Artifact Generationcited by 2
  4. 2026Video Models as Native 4D Renderers: World-Grounded Conditioning from Animated Meshcited by 2
  5. 2026SPRig: Self-Supervised Pose-Invariant Rigging from Mesh Sequencescited by 1
  6. 2026ViP-Rig: Visual-Prompted Controllable Riggingcited by 1
  7. 2025Attacks on Approximate Caches in Text-to-Image Diffusion Modelscited by 0
  8. 2025Make-It-Poseable: Feed-forward Latent Posing Model for 3D Characterscited by 0
  9. 2026Rigel3D: Rig-aware Latents for Animation-Ready 3D Asset Generationcited by 0
  10. 2026Follow Your Track: Precise Skeleton Animation Controlled by 3D Trajectoriescited by 0
  11. 2026G-Skin: Learning to Bind 3D Gaussians with Generative Visual Priorscited by 0
  12. 2026Branch-Centric Tokenization and Test-Time Augmentation for Skeleton Generationcited by 0