SK-Adapter: Skeleton-Based Structural Control for Native 3D Generation
Not on the map. Why?
Abstract (arXiv)
Native 3D generative models have achieved remarkable fidelity and speed, yet they suffer from a critical limitation: inability to prescribe precise structural articulations, where precise structural control within the native 3D space remains underexplored. This paper proposes SK-Adapter, a simple yet efficient and effective framework that unlocks precise skeletal manipulation for native 3D generation. Moving beyond text or image prompts, which can be ambiguous for precise structure, we treat the 3D skeleton as a first-class control signal. SK-Adapter is a lightweight structural adapter network that encodes joint coordinates and topology into learnable tokens, which are injected into the frozen 3D generation backbone via cross-attention. This design allows the model to not only effectively ``attend'' to specific 3D structural constraints but also preserve its original generative priors. To bridge the data gap, we contribute the Objaverse-TMS dataset, a large-scale dataset of 24k text-mesh-skeleton pairs. Extensive experiments confirm that our method achieves robust structural control while preserving the geometry and texture quality of the foundation model, significantly outperforming existing baselines. Furthermore, we extend this capability to local 3D editing, enabling region-specific editing of existing assets with skeletal guidance, which is unattainable by previous methods. Project page: https://sk-adapter.github.io/
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 62 of its 67 references that are in the map. First posted on arXiv 14 Mar 2026.
Builds on
62 of 67 references.
References · 62
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
38 more
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 2025SAM 3D: 3Dfy Anything in Imagescited by 230
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
- 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 214
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
- 2023Scalable 3D Captioning with Pretrained Modelscited by 201
- 2025Native and Compact Structured Latents for 3D Generationcited by 157
- 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 141
- 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 120
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 120
- 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 111
- 2023HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generationcited by 104
- 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 103
- 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 86
- 2023DreamWaltz: Make a Scene with Complex 3D Animatable Avatarscited by 82
- 2022GRPE: Relative Positional Encoding for Graph Transformercited by 67
- 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 60
- 2025HoloPart: Generative 3D Part Amodal Segmentationcited by 57
- 2025Amodal3R: Amodal 3D Reconstruction from Occluded 2D Imagescited by 52
- 2025Efficient Part-level 3D Object Generation via Dual Volume Packingcited by 47
- 2025One Model to Rig Them All: Diverse Skeleton Rigging with UniRigcited by 44
- 2025MagicArticulate: Make Your 3D Models Articulation-Readycited by 43
- 2025Ultra3D: Efficient and High-Fidelity 3D Generation with Part Attentioncited by 43
- 2025X-Part: high fidelity and structure coherent shape decompositioncited by 42
- 2025Puppeteer: Rig and Animate Your 3D Modelscited by 41
- 2025LATTICE: Democratize High-Fidelity 3D Generation at Scalecited by 41
- 2025VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Spacecited by 40
- 2025BANG: Dividing 3D Assets via Generative Exploded Dynamicscited by 35
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.