mlsanityData to 7 Oct 2026

PoseCraft: Tokenized 3D Body Landmark and Camera Conditioning for Photorealistic Human Image Synthesis

arXiv 2602.19350 ↗First posted 22 Feb 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Digitizing humans and synthesizing photorealistic avatars with explicit 3D pose and camera controls are central to VR, telepresence, and entertainment. Existing skinning-based workflows require laborious manual rigging or template-based fittings, while neural volumetric methods rely on canonical templates and re-optimization for each unseen pose. We present PoseCraft, a diffusion framework built around tokenized 3D interface: instead of relying only on rasterized geometry as 2D control images, we encode sparse 3D landmarks and camera extrinsics as discrete conditioning tokens and inject them into diffusion via cross-attention. Our approach preserves 3D semantics by avoiding 2D re-projection ambiguity under large pose and viewpoint changes, and produces photorealistic imagery that faithfully captures identity and appearance. To train and evaluate at scale, we also implement GenHumanRF, a data generation workflow that renders diverse supervision from volumetric reconstructions. Our experiments show that PoseCraft achieves significant perceptual quality improvement over diffusion-centric methods, and attains better or comparable metrics to latest volumetric rendering SOTA while better preserving fabric and hair details.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 41 of its 54 references that are in the map. First posted on arXiv 22 Feb 2026.

Builds on

41 of 54 references.

References · 41

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  7. 2022Generative Adversarial Networkscited by 5,603
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  9. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  10. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  11. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  12. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
29 more
  1. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  2. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
  3. 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
  4. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
  5. 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
  6. 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
  7. 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
  8. 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 154
  9. 2020Controllable Person Image Synthesis with Attribute-Decomposed GANcited by 150
  10. 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
  11. 2019Progressive Pose Attention Transfer for Person Image Generationcited by 138
  12. 2022Structured Local Radiance Fields for Human Avatar Modelingcited by 116
  13. 2022Person Image Synthesis via Denoising Diffusion Modelcited by 104
  14. 2023HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generationcited by 104
  15. 2020SMPLpix: Neural Avatars from 3D Human Modelscited by 69
  16. 2022Exploring Dual-task Correlation for Pose Guided Person Image Generationcited by 68
  17. 2023HyperHuman: Hyper-Realistic Human Generation with Latent Structural Diffusioncited by 68
  18. 2021PISE: Person Image Synthesis and Editing with Decoupled GANcited by 62
  19. 2024Human4DiT: 360-degree Human Video Generation with 4D Diffusion Transformercited by 61
  20. 2022Neural Texture Extraction and Distribution for Controllable Person Image Synthesiscited by 55
  21. 2023PoseVocab: Learning Joint-structured Pose Embeddings for Human Avatar Modelingcited by 50
  22. 2024Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesiscited by 48
  23. 2022Cross Attention Based Style Distribution for Controllable Person Image Synthesiscited by 45
  24. 2021Learning Semantic Person Image Generation by Region-Adaptive Normalizationcited by 44
  25. 2020Deep Spatial Transformation for Pose-Guided Person Image Generation and Animationcited by 43
  26. 2021Multi-View Multi-Person 3D Pose Estimation with Plane Sweep Stereocited by 38
  27. 2021Graph-Based 3D Multi-Person Pose Estimation Using Multi-View Imagescited by 38
  28. 2022Neural Point-based Shape Modeling of Humans in Challenging Clothingcited by 29
  29. 2024MPL: Lifting 3D Human Pose from Multi-view 2D Posescited by 4

Built on by

Not cited yet.