DRiVE: Diffusion-based Rigging Empowers Generation of Versatile and Expressive Characters
Not on the map. Why?
Abstract (arXiv)
Recent advances in generative models have enabled high-quality 3D character reconstruction from multi-modal. However, animating these generated characters remains a challenging task, especially for complex elements like garments and hair, due to the lack of large-scale datasets and effective rigging methods. To address this gap, we curate AnimeRig, a large-scale dataset with detailed skeleton and skinning annotations. Building upon this, we propose DRiVE, a novel framework for generating and rigging 3D human characters with intricate structures. Unlike existing methods, DRiVE utilizes a 3D Gaussian representation, facilitating efficient animation and high-quality rendering. We further introduce GSDiff, a 3D Gaussian-based diffusion module that predicts joint positions as spatial distributions, overcoming the limitations of regression-based approaches. Extensive experiments demonstrate that DRiVE achieves precise rigging results, enabling realistic dynamics for clothing and hair, and surpassing previous methods in both quality and versatility. The code and dataset will be made public for academic use upon acceptance.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 67 of its 84 references that are in the map. First posted on arXiv 26 Nov 2024.
Builds on
67 of 84 references.
References · 67
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
38 more
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
- 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 384
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2016Convolutional Pose Machinescited by 325
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 256
- 2017Hand Keypoint Detection in Single Images using Multiview Bootstrappingcited by 231
- 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 227
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 195
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 190
- 2024SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splattingcited by 171
- 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
- 2022SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Videocited by 144
- 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Imagecited by 132
- 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 122
- 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 120
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 99
- 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
- 2023HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generationcited by 88
- 2023PC2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstructioncited by 84
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2025: 10; 2026: 14.
24 papers.
Sort:
By area:
- 2025Puppeteer: Rig and Animate Your 3D Modelscited by 41
- 2025GAS: Generative Avatar Synthesis from a Single Imagecited by 19
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 18
- 2025SIGMAN:Scaling 3D Human Gaussian Generation with Millions of Assetscited by 12
- 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generationcited by 12
- 2025Auto-Connect: Connectivity-Preserving RigFormer with Direct Preference Optimizationcited by 7
- 2026HVG-3D: Bridging Real and Simulation Domains for 3D-Conditional Hand-Object Interaction Video Synthesiscited by 7
- 2026Skin Tokens: A Learned Compact Representation for Unified Autoregressive Riggingcited by 5
- 2026LottieGPT: Tokenizing Vector Animation for Autoregressive Generationcited by 5
- 2025ARMO: Autoregressive Rigging for Multi-Category Objectscited by 4
- 2025LLMsPark: A Benchmark for Evaluating Large Language Models in Strategic Gaming Contextscited by 4
- 2026AniGen: Unified S3 Fields for Animatable 3D Asset Generationcited by 3
12 more
- 2026Engine-Native Editable 3D World Reconstruction with Objects and Lightingcited by 3
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenescited by 2
- 2026PairCoder++: Pair Programming as a Universal Paradigm for Verified Code-Driven Multimodal and Structured-Artifact Generationcited by 2
- 2026Video Models as Native 4D Renderers: World-Grounded Conditioning from Animated Meshcited by 2
- 2026SPRig: Self-Supervised Pose-Invariant Rigging from Mesh Sequencescited by 1
- 2026ViP-Rig: Visual-Prompted Controllable Riggingcited by 1
- 2025Attacks on Approximate Caches in Text-to-Image Diffusion Modelscited by 0
- 2025Make-It-Poseable: Feed-forward Latent Posing Model for 3D Characterscited by 0
- 2026Rigel3D: Rig-aware Latents for Animation-Ready 3D Asset Generationcited by 0
- 2026Follow Your Track: Precise Skeleton Animation Controlled by 3D Trajectoriescited by 0
- 2026G-Skin: Learning to Bind 3D Gaussians with Generative Visual Priorscited by 0
- 2026Branch-Centric Tokenization and Test-Time Augmentation for Skeleton Generationcited by 0
- 2026Branch-Centric Tokenization and Test-Time Augmentation for Skeleton Generation5 Sep 2026
- 2026G-Skin: Learning to Bind 3D Gaussians with Generative Visual Priors3 Aug 2026
- 2026Video Models as Native 4D Renderers: World-Grounded Conditioning from Animated Mesh30 Jul 2026
- 2026ViP-Rig: Visual-Prompted Controllable Rigging30 Jul 2026
- 2026Engine-Native Editable 3D World Reconstruction with Objects and Lighting23 Jul 2026
- 2026PairCoder++: Pair Programming as a Universal Paradigm for Verified Code-Driven Multimodal and Structured-Artifact Generation2 Jul 2026
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenes30 Jun 2026
- 2026Follow Your Track: Precise Skeleton Animation Controlled by 3D Trajectories24 Jun 2026
- 2026Rigel3D: Rig-aware Latents for Animation-Ready 3D Asset Generation13 May 2026
- 2026LottieGPT: Tokenizing Vector Animation for Autoregressive Generation13 Apr 2026
- 2026AniGen: Unified S3 Fields for Animatable 3D Asset Generation9 Apr 2026
- 2026HVG-3D: Bridging Real and Simulation Domains for 3D-Conditional Hand-Object Interaction Video Synthesis31 Mar 2026
12 more
- 2026SPRig: Self-Supervised Pose-Invariant Rigging from Mesh Sequences13 Feb 2026
- 2026Skin Tokens: A Learned Compact Representation for Unified Autoregressive Rigging4 Feb 2026
- 2025Make-It-Poseable: Feed-forward Latent Posing Model for 3D Characters18 Dec 2025
- 2025LLMsPark: A Benchmark for Evaluating Large Language Models in Strategic Gaming Contexts20 Sep 2025
- 2025Attacks on Approximate Caches in Text-to-Image Diffusion Models28 Aug 2025
- 2025Puppeteer: Rig and Animate Your 3D Models14 Aug 2025
- 2025Auto-Connect: Connectivity-Preserving RigFormer with Direct Preference Optimization13 Jun 2025
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videos10 Jun 2025
- 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generation23 May 2025
- 2025SIGMAN:Scaling 3D Human Gaussian Generation with Millions of Assets9 Apr 2025
- 2025ARMO: Autoregressive Rigging for Multi-Category Objects26 Mar 2025
- 2025GAS: Generative Avatar Synthesis from a Single Image10 Feb 2025
- 2025Puppeteer: Rig and Animate Your 3D Modelscited by 41
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 18
- 2025SIGMAN:Scaling 3D Human Gaussian Generation with Millions of Assetscited by 12
- 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generationcited by 12
- 2025Auto-Connect: Connectivity-Preserving RigFormer with Direct Preference Optimizationcited by 7
- 2026HVG-3D: Bridging Real and Simulation Domains for 3D-Conditional Hand-Object Interaction Video Synthesiscited by 7
- 2026Skin Tokens: A Learned Compact Representation for Unified Autoregressive Riggingcited by 5
- 2026LottieGPT: Tokenizing Vector Animation for Autoregressive Generationcited by 5
- 2025ARMO: Autoregressive Rigging for Multi-Category Objectscited by 4
- 2025LLMsPark: A Benchmark for Evaluating Large Language Models in Strategic Gaming Contextscited by 4
- 2026AniGen: Unified S3 Fields for Animatable 3D Asset Generationcited by 3
- 2026Engine-Native Editable 3D World Reconstruction with Objects and Lightingcited by 3
12 most cited of 21 All 21 (JSON)
- 2026Branch-Centric Tokenization and Test-Time Augmentation for Skeleton Generation5 Sep 2026
- 2026G-Skin: Learning to Bind 3D Gaussians with Generative Visual Priors3 Aug 2026
- 2026ViP-Rig: Visual-Prompted Controllable Rigging30 Jul 2026
- 2026Engine-Native Editable 3D World Reconstruction with Objects and Lighting23 Jul 2026
- 2026PairCoder++: Pair Programming as a Universal Paradigm for Verified Code-Driven Multimodal and Structured-Artifact Generation2 Jul 2026
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenes30 Jun 2026
- 2026Follow Your Track: Precise Skeleton Animation Controlled by 3D Trajectories24 Jun 2026
- 2026Rigel3D: Rig-aware Latents for Animation-Ready 3D Asset Generation13 May 2026
- 2026LottieGPT: Tokenizing Vector Animation for Autoregressive Generation13 Apr 2026
- 2026AniGen: Unified S3 Fields for Animatable 3D Asset Generation9 Apr 2026
- 2026HVG-3D: Bridging Real and Simulation Domains for 3D-Conditional Hand-Object Interaction Video Synthesis31 Mar 2026
- 2026SPRig: Self-Supervised Pose-Invariant Rigging from Mesh Sequences13 Feb 2026
12 newest of 21 All 21 (JSON)