mlsanityData to 7 Oct 2026

SMPLitex: A Generative Model and Dataset for 3D Human Texture Estimation from Single Image

arXiv 2309.01855 ↗First posted 4 Sep 2023cs.CV cs.GRcited by 30

Not on the map. Why?

Abstract (arXiv)

We propose SMPLitex, a method for estimating and manipulating the complete 3D appearance of humans captured from a single image. SMPLitex builds upon the recently proposed generative models for 2D images, and extends their use to the 3D domain through pixel-to-surface correspondences computed on the input image. To this end, we first train a generative model for complete 3D human appearance, and then fit it into the input image by conditioning the generative model to the visible parts of the subject. Furthermore, we propose a new dataset of high-quality human textures built by sampling SMPLitex conditioned on subject descriptions and images. We quantitatively and qualitatively evaluate our method in 3 publicly available datasets, demonstrating that SMPLitex significantly outperforms existing methods for human texture estimation while allowing for a wider variety of tasks such as editing, synthesis, and manipulation

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 54 of its 63 references that are in the map. First posted on arXiv 4 Sep 2023.

Builds on

54 of 63 references.

References · 54

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  6. 2022Generative Adversarial Networkscited by 5,603
  7. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  8. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  9. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  10. 2022Video Diffusion Modelscited by 2,280
  11. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  12. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
38 more
  1. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
  2. 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
  3. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  4. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 501
  5. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  6. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  7. 2017Learning from Synthetic Humanscited by 358
  8. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
  9. 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
  10. 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolationcited by 307
  11. 2022Novel View Synthesis with Diffusion Modelscited by 299
  12. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  13. 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
  14. 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
  15. 2018Video Based Reconstruction of 3D People Modelscited by 237
  16. 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
  17. 2021Neural Articulated Radiance Fieldcited by 196
  18. 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
  19. 2020Controllable Person Image Synthesis with Attribute-Decomposed GANcited by 150
  20. 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
  21. 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
  22. 2021Real-time Deep Dynamic Characterscited by 133
  23. 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
  24. 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
  25. 2018Dense Pose Transfercited by 83
  26. 2019360-Degree Textures of People in Clothing from a Single Imagecited by 75
  27. 2020SMPLpix: Neural Avatars from 3D Human Modelscited by 69
  28. 2018SiCloPe: Silhouette-Based Clothed Peoplecited by 68
  29. 2021StylePeople: A Generative Model of Fullbody Human Avatarscited by 62
  30. 2023AvatarVerse: High-quality & Stable 3D Avatar Creation from Text and Posecited by 60
  31. 2020Learning to Transfer Texture from Clothing Images to 3D Humanscited by 58
  32. 2018Unsupervised Person Image Synthesis in Arbitrary Posescited by 55
  33. 2021Style and Pose Control for Image Synthesis of Humans from a Single Monocular Viewcited by 53
  34. 20213D Human Texture Estimation from a Single Image with Transformerscited by 35
  35. 2016Photorealistic Facial Texture Inference Using Deep Neural Networkscited by 32
  36. 20213D Human Pose, Shape and Texture from Low-Resolution Images and Videoscited by 26
  37. 2022AvatarCap: Animatable Avatar Conditioned Monocular Human Volumetric Capturecited by 25
  38. 2019Re-Identification Supervised Texture Generationcited by 19

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 13; 2025: 11; 2026: 5.

30 papers.

Sort:

By area:

  1. 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
  2. 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interactioncited by 63
  3. 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimationcited by 57
  4. 2024TexDreamer: Towards Zero-Shot High-Fidelity 3D Human Texture Generationcited by 14
  5. 2024DreamHOI: Subject-Driven Generation of 3D Human-Object Interactions with Diffusion Priorscited by 9
  6. 2024TexTile: A Differentiable Metric for Texture Tileabilitycited by 7
  7. 2024UVMap-ID: A Controllable and Personalized UV Map Generative Modelcited by 7
  8. 2025HumanGif: Single-View Human Diffusion with Generative Priorcited by 7
  9. 2025Stable-SCore: A Stable Registration-based Framework for 3D Shape Correspondencecited by 7
  10. 2025Ges3ViG: Incorporating Pointing Gestures into Language-Based 3D Visual Grounding for Embodied Reference Understandingcited by 7
  11. 2024BodyShapeGPT: SMPL Body Shape Manipulation with LLMscited by 6
  12. 2024Synthesizing Moving People with 3D Controlcited by 5
18 more
  1. 2025Surface-Aware Distilled 3D Semantic Featurescited by 5
  2. 2024CFSynthesis: Controllable and Free-view 3D Human Video Synthesiscited by 3
  3. 2025SMPL-GPTexture: Dual-View 3D Human Texture Estimation using Text-to-Image Generation Modelscited by 2
  4. 2024VHS: High-Resolution Iterative Stereo Matching with Visual Hull Priorscited by 1
  5. 2024FabricDiffusion: High-Fidelity Texture Transfer for 3D Garments Generation from In-The-Wild Clothing Imagescited by 1
  6. 2024FashionR2R: Texture-preserving Rendered-to-Real Image Translation with Diffusion Modelscited by 1
  7. 2025HuGeDiff: 3D Human Generation via Diffusion with Gaussian Splattingcited by 1
  8. 2026AnyHand: A Large-Scale Synthetic Dataset for RGB(-D) Hand Pose Estimationcited by 1
  9. 2024Towards Zero-Shot Interpretable Human Recognition: A 2D-3D Registration Frameworkcited by 0
  10. 2025HOIverse: A Synthetic Scene Graph Dataset With Human Object Interactionscited by 0
  11. 2025EgoAnimate: Generating Human Animations from Egocentric top-down Viewscited by 0
  12. 2025Learning 3D Texture-Aware Representations for Parsing Diverse Human Clothing and Body Partscited by 0
  13. 2025VOccl3D: A Video Benchmark Dataset for 3D Human Pose and Shape Estimation under real Occlusionscited by 0
  14. 2025Blur2Sharp: Human Novel Pose and View Synthesis with Generative Prior Refinementcited by 0
  15. 2026GenPHRI: Agentic Generative Simulation for Physical Human-Robot Interactioncited by 0
  16. 2026BooST: Bridging Semantics and Motions for Efficient Skill Transfercited by 0
  17. 2026Revisiting Avatar-As-Image: High-Fidelity Registration is All You Needcited by 0
  18. 2026SynDORBench: Evaluating LVLM Perceptual Robustness Under Physically Constrained Visibility Conditionscited by 0