AniGen: Unified S3 Fields for Animatable 3D Asset Generation
Not on the map. Why?
Abstract (arXiv)
Animatable 3D assets, defined as geometry equipped with an articulated skeleton and skinning weights, are fundamental to interactive graphics, embodied agents, and animation production. While recent 3D generative models can synthesize visually plausible shapes from images, the results are typically static. Obtaining usable rigs via post-hoc auto-rigging is brittle and often produces skeletons that are topologically inconsistent with the generated geometry. We present AniGen, a unified framework that directly generates animate-ready 3D assets conditioned on a single image. Our key insight is to represent shape, skeleton, and skinning as mutually consistent S3 Fields (Shape, Skeleton, Skin) defined over a shared spatial domain. To enable the robust learning of these fields, we introduce two technical innovations: (i) a confidence-decaying skeleton field that explicitly handles the geometric ambiguity of bone prediction at Voronoi boundaries, and (ii) a dual skin feature field that decouples skinning weights from specific joint counts, allowing a fixed-architecture network to predict rigs of arbitrary complexity. Built upon a two-stage flow-matching pipeline, AniGen first synthesizes a sparse structural scaffold and then generates dense geometry and articulation in a structured latent space. Extensive experiments demonstrate that AniGen substantially outperforms state-of-the-art sequential baselines in rig validity and animation quality, generalizing effectively to in-the-wild images across diverse categories including animals, humanoids, and machinery. Homepage: https://yihua7.github.io/AniGen-web/
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 55 of its 77 references that are in the map. First posted on arXiv 9 Apr 2026.
Builds on
55 of 77 references.
References · 55
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
38 more
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
- 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 214
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
- 2025Native and Compact Structured Latents for 3D Generationcited by 175
- 2023Flexible Isosurface Extraction for Gradient-Based Mesh Optimizationcited by 139
- 2023Text-to-3D with Classifier Score Distillationcited by 128
- 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 79
- 2023ProSpect: Prompt Spectrum for Attribute-Aware Personalization of Diffusion Modelscited by 75
- 2024SC4D: Sparse-Controlled Video-to-4D Generation and Motion Transfercited by 61
- 2021Learning Skeletal Articulations with Neural Blend Shapescited by 53
- 2025RigAnything: Template-Free Autoregressive Rigging for Diverse 3D Assetscited by 47
- 2025One Model to Rig Them All: Diverse Skeleton Rigging with UniRigcited by 45
- 2025Ultra3D: Efficient and High-Fidelity 3D Generation with Part Attentioncited by 44
- 2025Puppeteer: Rig and Animate Your 3D Modelscited by 43
- 2025AnyTop: Character Animation Diffusion with Any Topologycited by 41
- 2019Predicting Animation Skeletons for 3D Articulated Models via Volumetric Netscited by 39
- 2020RigNet: Neural Rigging for Articulated Characterscited by 32
- 2025AnimateAnyMesh: A Feed-Forward 4D Foundation Model for Text-Driven Universal Mesh Animationcited by 32
- 2025Towards Scalable Pre-training of Visual Tokenizers for Generationcited by 28
- 2025Anymate: A Dataset and Baselines for Learning 3D Object Riggingcited by 27
- 2024DRiVE: Diffusion-based Rigging Empowers Generation of Versatile and Expressive Characterscited by 24
- 2025Particulate: Feed-Forward 3D Object Articulationcited by 23
- 2022Morig: Motion-aware rigging of character meshes from point cloudscited by 20
- 2024SVG: 3D Stereoscopic Video Generation via Denoising Frame Matrixcited by 20
- 2025AnimaX: Animating the Inanimate in 3D with Joint Video-Pose Diffusion Modelscited by 15
- 2019Cubic Stylizationcited by 14
- 2025ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latentscited by 11
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Skin Tokens: A Learned Compact Representation for Unified Autoregressive Rigging
- 2023AnimatableDreamer: Text-Guided Non-rigid 3D Model Generation and Reconstruction with Canonical Score Distillation
- 2026Stroke3D: Lifting 2D strokes into rigged 3D model via latent diffusion models
- 2025ARMO: Autoregressive Rigging for Multi-Category Objects
- 2023ARTIC3D: Learning Robust Articulated 3D Shapes from Noisy Web Image Collections
- 2026UniMate: One Unified Model to Animate Diverse Skeletons
- 2024Structured 3D Latents for Scalable and Versatile 3D Generation
- 2024GEM3D: GEnerative Medial Abstractions for 3D Shape Synthesis