Anymate: A Dataset and Baselines for Learning 3D Object Rigging
Not on the map. Why?
Abstract (arXiv)
Rigging and skinning are essential steps to create realistic 3D animations, often requiring significant expertise and manual effort. Traditional attempts at automating these processes rely heavily on geometric heuristics and often struggle with objects of complex geometry. Recent data-driven approaches show potential for better generality, but are often constrained by limited training data. We present the Anymate Dataset, a large-scale dataset of 230K 3D assets paired with expert-crafted rigging and skinning information -- 70 times larger than existing datasets. Using this dataset, we propose a learning-based auto-rigging framework with three sequential modules for joint, connectivity, and skinning weight prediction. We systematically design and experiment with various architectures as baselines for each module and conduct comprehensive evaluations on our dataset to compare their performance. Our models significantly outperform existing methods, providing a foundation for comparing future methods in automated rigging and skinning. Code and dataset can be found at https://anymate3d.github.io/.
Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). Builds on 31 of its 56 references that are in the map. First posted on arXiv 9 May 2025.
Builds on
31 of 56 references.
References · 31
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 735
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
19 more
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
- 2023PointLLM: Empowering Large Language Models to Understand Point Cloudscited by 333
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 2023Scalable 3D Captioning with Pretrained Modelscited by 203
- 20214DComplete: Non-Rigid Motion Estimation Beyond the Observable Surfacecited by 124
- 2021KeypointDeformer: Unsupervised 3D Keypoint Discovery for Shape Controlcited by 51
- 2025RigAnything: Template-Free Autoregressive Rigging for Diverse 3D Assetscited by 47
- 2025MagicArticulate: Make Your 3D Models Articulation-Readycited by 43
- 2019Predicting Animation Skeletons for 3D Articulated Models via Volumetric Netscited by 39
- 2021DeepMetaHandles: Learning Deformation Meta-Handles of 3D Meshes with Biharmonic Coordinatescited by 37
- 2022CASA: Category-agnostic Skeletal Animal Reconstructioncited by 35
- 2024Puppet-Master: Scaling Interactive Video Generation as a Motion Prior for Part-Level Dynamicscited by 28
- 2023Neural Face Rigging for Animating and Retargeting Facial Meshes in the Wildcited by 25
- 2023RaBit: Parametric Modeling of 3D Biped Cartoon Characters with a Topological-consistent Datasetcited by 18
- 2022SkinningNet: Two-Stream Graph Convolutional Neural Network for Skinning Prediction of Synthetic Characterscited by 16
- 2024PointInfinity: Resolution-Invariant Point Diffusion Modelscited by 15
- 2023VINECS: Video-based Neural Character Skinningcited by 6
Built on by
Citing papers per year: 2025: 9; 2026: 18.
27 papers.
Sort:
By area:
- 2025Puppeteer: Rig and Animate Your 3D Modelscited by 43
- 2025Particulate: Feed-Forward 3D Object Articulationcited by 23
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 19
- 2026Motion 3-to-4: 3D Motion Reconstruction for 4D Synthesiscited by 15
- 2025ART: Articulated Reconstruction Transformercited by 9
- 2025Stable Part Diffusion 4D: Multi-View RGB and Kinematic Parts Video Generationcited by 5
- 2026Choreographing a World of Dynamic Objectscited by 5
- 2026Skin Tokens: A Learned Compact Representation for Unified Autoregressive Riggingcited by 5
- 2026BiMotion: B-spline Motion for Text-guided Dynamic 3D Character Generationcited by 4
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Controlcited by 4
- 2026AniGen: Unified S3 Fields for Animatable 3D Asset Generationcited by 3
- 2026ViPS: Video-informed Pose Spaces for Auto-Rigged Meshescited by 3
15 more
- 2025RigAnyFace: Scaling Neural Facial Mesh Auto-Rigging with Unlabeled Datacited by 2
- 2026Stroke3D: Lifting 2D strokes into rigged 3D model via latent diffusion modelscited by 2
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twinscited by 2
- 2025Droplet3D: Commonsense Priors from Videos Facilitate 3D Generationcited by 1
- 2025MimiCAT: Mimic with Correspondence-Aware Cascade-Transformer for Category-Free 3D Pose Transfercited by 1
- 2026SK-Adapter: Skeleton-Based Structural Control for Native 3D Generationcited by 1
- 2026OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologiescited by 1
- 2026SAMoR: Motion Modelling for Articulated Objects of Any Skeleton and Topologycited by 1
- 2026Visual General Intelligence: A White Papercited by 1
- 2025Make-It-Poseable: Feed-forward Latent Posing Model for 3D Characterscited by 0
- 2026PhysSkin: Real-Time and Generalizable Physics-Based Animation via Self-Supervised Neural Skinningcited by 0
- 2026GaussiAnimate: Rig Animatable Categories with Level of Dynamicscited by 0
- 2026Rigel3D: Rig-aware Latents for Animation-Ready 3D Asset Generationcited by 0
- 2026G-Skin: Learning to Bind 3D Gaussians with Generative Visual Priorscited by 0
- 2026Branch-Centric Tokenization and Test-Time Augmentation for Skeleton Generationcited by 0
- 2026Branch-Centric Tokenization and Test-Time Augmentation for Skeleton Generation5 Sep 2026
- 2026Visual General Intelligence: A White Paper26 Aug 2026
- 2026G-Skin: Learning to Bind 3D Gaussians with Generative Visual Priors3 Aug 2026
- 2026SAMoR: Motion Modelling for Articulated Objects of Any Skeleton and Topology2 Jul 2026
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control12 Jun 2026
- 2026OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologies6 Jun 2026
- 2026Rigel3D: Rig-aware Latents for Animation-Ready 3D Asset Generation13 May 2026
- 2026ViPS: Video-informed Pose Spaces for Auto-Rigged Meshes19 Apr 2026
- 2026AniGen: Unified S3 Fields for Animatable 3D Asset Generation9 Apr 2026
- 2026GaussiAnimate: Rig Animatable Categories with Level of Dynamics9 Apr 2026
- 2026PhysSkin: Real-Time and Generalizable Physics-Based Animation via Self-Supervised Neural Skinning24 Mar 2026
- 2026SK-Adapter: Skeleton-Based Structural Control for Native 3D Generation14 Mar 2026
15 more
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twins13 Mar 2026
- 2026BiMotion: B-spline Motion for Text-guided Dynamic 3D Character Generation21 Feb 2026
- 2026Stroke3D: Lifting 2D strokes into rigged 3D model via latent diffusion models10 Feb 2026
- 2026Skin Tokens: A Learned Compact Representation for Unified Autoregressive Rigging4 Feb 2026
- 2026Motion 3-to-4: 3D Motion Reconstruction for 4D Synthesis20 Jan 2026
- 2026Choreographing a World of Dynamic Objects7 Jan 2026
- 2025Make-It-Poseable: Feed-forward Latent Posing Model for 3D Characters18 Dec 2025
- 2025ART: Articulated Reconstruction Transformer16 Dec 2025
- 2025Particulate: Feed-Forward 3D Object Articulation12 Dec 2025
- 2025RigAnyFace: Scaling Neural Facial Mesh Auto-Rigging with Unlabeled Data23 Nov 2025
- 2025MimiCAT: Mimic with Correspondence-Aware Cascade-Transformer for Category-Free 3D Pose Transfer23 Nov 2025
- 2025Stable Part Diffusion 4D: Multi-View RGB and Kinematic Parts Video Generation12 Sep 2025
- 2025Droplet3D: Commonsense Priors from Videos Facilitate 3D Generation28 Aug 2025
- 2025Puppeteer: Rig and Animate Your 3D Models14 Aug 2025
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videos10 Jun 2025
- 2025Puppeteer: Rig and Animate Your 3D Modelscited by 43
- 2025Particulate: Feed-Forward 3D Object Articulationcited by 23
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 19
- 2026Motion 3-to-4: 3D Motion Reconstruction for 4D Synthesiscited by 15
- 2025ART: Articulated Reconstruction Transformercited by 9
- 2025Stable Part Diffusion 4D: Multi-View RGB and Kinematic Parts Video Generationcited by 5
- 2026Choreographing a World of Dynamic Objectscited by 5
- 2026Skin Tokens: A Learned Compact Representation for Unified Autoregressive Riggingcited by 5
- 2026BiMotion: B-spline Motion for Text-guided Dynamic 3D Character Generationcited by 4
- 2026AniGen: Unified S3 Fields for Animatable 3D Asset Generationcited by 3
- 2025RigAnyFace: Scaling Neural Facial Mesh Auto-Rigging with Unlabeled Datacited by 2
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twinscited by 2
12 most cited of 24 All 24 (JSON)
- 2026Branch-Centric Tokenization and Test-Time Augmentation for Skeleton Generation5 Sep 2026
- 2026Visual General Intelligence: A White Paper26 Aug 2026
- 2026G-Skin: Learning to Bind 3D Gaussians with Generative Visual Priors3 Aug 2026
- 2026SAMoR: Motion Modelling for Articulated Objects of Any Skeleton and Topology2 Jul 2026
- 2026OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologies6 Jun 2026
- 2026Rigel3D: Rig-aware Latents for Animation-Ready 3D Asset Generation13 May 2026
- 2026AniGen: Unified S3 Fields for Animatable 3D Asset Generation9 Apr 2026
- 2026GaussiAnimate: Rig Animatable Categories with Level of Dynamics9 Apr 2026
- 2026PhysSkin: Real-Time and Generalizable Physics-Based Animation via Self-Supervised Neural Skinning24 Mar 2026
- 2026SK-Adapter: Skeleton-Based Structural Control for Native 3D Generation14 Mar 2026
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twins13 Mar 2026
- 2026BiMotion: B-spline Motion for Text-guided Dynamic 3D Character Generation21 Feb 2026
12 newest of 24 All 24 (JSON)