mlsanityData to 7 Oct 2026

SK-Adapter: Skeleton-Based Structural Control for Native 3D Generation

arXiv 2603.14152 ↗First posted 14 Mar 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Native 3D generative models have achieved remarkable fidelity and speed, yet they suffer from a critical limitation: inability to prescribe precise structural articulations, where precise structural control within the native 3D space remains underexplored. This paper proposes SK-Adapter, a simple yet efficient and effective framework that unlocks precise skeletal manipulation for native 3D generation. Moving beyond text or image prompts, which can be ambiguous for precise structure, we treat the 3D skeleton as a first-class control signal. SK-Adapter is a lightweight structural adapter network that encodes joint coordinates and topology into learnable tokens, which are injected into the frozen 3D generation backbone via cross-attention. This design allows the model to not only effectively ``attend'' to specific 3D structural constraints but also preserve its original generative priors. To bridge the data gap, we contribute the Objaverse-TMS dataset, a large-scale dataset of 24k text-mesh-skeleton pairs. Extensive experiments confirm that our method achieves robust structural control while preserving the geometry and texture quality of the foundation model, significantly outperforming existing baselines. Furthermore, we extend this capability to local 3D editing, enabling region-specific editing of existing assets with skeletal guidance, which is unattainable by previous methods. Project page: https://sk-adapter.github.io/

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 62 of its 67 references that are in the map. First posted on arXiv 14 Mar 2026.

Builds on

62 of 67 references.

References · 62

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  5. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  6. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  7. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  8. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  9. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  10. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
  11. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  12. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
38 more
  1. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  2. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  3. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  4. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  5. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  6. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  7. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
  8. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
  9. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
  10. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  11. 2025SAM 3D: 3Dfy Anything in Imagescited by 230
  12. 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
  13. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 214
  14. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  15. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
  16. 2023Scalable 3D Captioning with Pretrained Modelscited by 201
  17. 2025Native and Compact Structured Latents for 3D Generationcited by 157
  18. 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 141
  19. 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 120
  20. 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 120
  21. 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 111
  22. 2023HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generationcited by 104
  23. 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 103
  24. 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 86
  25. 2023DreamWaltz: Make a Scene with Complex 3D Animatable Avatarscited by 82
  26. 2022GRPE: Relative Positional Encoding for Graph Transformercited by 67
  27. 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 60
  28. 2025HoloPart: Generative 3D Part Amodal Segmentationcited by 57
  29. 2025Amodal3R: Amodal 3D Reconstruction from Occluded 2D Imagescited by 52
  30. 2025Efficient Part-level 3D Object Generation via Dual Volume Packingcited by 47
  31. 2025One Model to Rig Them All: Diverse Skeleton Rigging with UniRigcited by 44
  32. 2025MagicArticulate: Make Your 3D Models Articulation-Readycited by 43
  33. 2025Ultra3D: Efficient and High-Fidelity 3D Generation with Part Attentioncited by 43
  34. 2025X-Part: high fidelity and structure coherent shape decompositioncited by 42
  35. 2025Puppeteer: Rig and Animate Your 3D Modelscited by 41
  36. 2025LATTICE: Democratize High-Fidelity 3D Generation at Scalecited by 41
  37. 2025VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Spacecited by 40
  38. 2025BANG: Dividing 3D Assets via Generative Exploded Dynamicscited by 35

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.