PoseCraft: Tokenized 3D Body Landmark and Camera Conditioning for Photorealistic Human Image Synthesis
Not on the map. Why?
Abstract (arXiv)
Digitizing humans and synthesizing photorealistic avatars with explicit 3D pose and camera controls are central to VR, telepresence, and entertainment. Existing skinning-based workflows require laborious manual rigging or template-based fittings, while neural volumetric methods rely on canonical templates and re-optimization for each unseen pose. We present PoseCraft, a diffusion framework built around tokenized 3D interface: instead of relying only on rasterized geometry as 2D control images, we encode sparse 3D landmarks and camera extrinsics as discrete conditioning tokens and inject them into diffusion via cross-attention. Our approach preserves 3D semantics by avoiding 2D re-projection ambiguity under large pose and viewpoint changes, and produces photorealistic imagery that faithfully captures identity and appearance. To train and evaluate at scale, we also implement GenHumanRF, a data generation workflow that renders diverse supervision from volumetric reconstructions. Our experiments show that PoseCraft achieves significant perceptual quality improvement over diffusion-centric methods, and attains better or comparable metrics to latest volumetric rendering SOTA while better preserving fabric and hair details.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 41 of its 54 references that are in the map. First posted on arXiv 22 Feb 2026.
Builds on
41 of 54 references.
References · 41
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Generative Adversarial Networkscited by 5,603
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
29 more
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
- 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
- 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
- 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
- 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 154
- 2020Controllable Person Image Synthesis with Attribute-Decomposed GANcited by 150
- 2022ARAH: Animatable Volume Rendering of Articulated Human SDFscited by 139
- 2019Progressive Pose Attention Transfer for Person Image Generationcited by 138
- 2022Structured Local Radiance Fields for Human Avatar Modelingcited by 116
- 2022Person Image Synthesis via Denoising Diffusion Modelcited by 104
- 2023HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generationcited by 104
- 2020SMPLpix: Neural Avatars from 3D Human Modelscited by 69
- 2022Exploring Dual-task Correlation for Pose Guided Person Image Generationcited by 68
- 2023HyperHuman: Hyper-Realistic Human Generation with Latent Structural Diffusioncited by 68
- 2021PISE: Person Image Synthesis and Editing with Decoupled GANcited by 62
- 2024Human4DiT: 360-degree Human Video Generation with 4D Diffusion Transformercited by 61
- 2022Neural Texture Extraction and Distribution for Controllable Person Image Synthesiscited by 55
- 2023PoseVocab: Learning Joint-structured Pose Embeddings for Human Avatar Modelingcited by 50
- 2024Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesiscited by 48
- 2022Cross Attention Based Style Distribution for Controllable Person Image Synthesiscited by 45
- 2021Learning Semantic Person Image Generation by Region-Adaptive Normalizationcited by 44
- 2020Deep Spatial Transformation for Pose-Guided Person Image Generation and Animationcited by 43
- 2021Multi-View Multi-Person 3D Pose Estimation with Plane Sweep Stereocited by 38
- 2021Graph-Based 3D Multi-Person Pose Estimation Using Multi-View Imagescited by 38
- 2022Neural Point-based Shape Modeling of Humans in Challenging Clothingcited by 29
- 2024MPL: Lifting 3D Human Pose from Multi-view 2D Posescited by 4
Built on by
Not cited yet.