mlsanityData to 7 Oct 2026

Ultraman: Single Image 3D Human Reconstruction with Ultra Speed and Detail

arXiv 2403.12028 ↗First posted 18 Mar 2024cs.CV cs.AI eess.IVcited by 12

Not on the map. Why?

Abstract (arXiv)

3D human body reconstruction has been a challenge in the field of computer vision. Previous methods are often time-consuming and difficult to capture the detailed appearance of the human body. In this paper, we propose a new method called Ultraman for fast reconstruction of textured 3D human models from a single image. Compared to existing techniques, Ultraman greatly improves the reconstruction speed and accuracy while preserving high-quality texture details. We present a set of new frameworks for human reconstruction consisting of three parts, geometric reconstruction, texture generation and texture mapping. Firstly, a mesh reconstruction framework is used, which accurately extracts 3D human shapes from a single image. At the same time, we propose a method to generate a multi-view consistent image of the human body based on a single image. This is finally combined with a novel texture mapping method to optimize texture details and ensure color consistency during reconstruction. Through extensive experiments and evaluations, we demonstrate the superior performance of Ultraman on various standard datasets. In addition, Ultraman outperforms state-of-the-art methods in terms of human rendering quality and speed. Upon acceptance of the article, we will make the code and data publicly available.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 37 of its 51 references that are in the map. First posted on arXiv 18 Mar 2024.

Builds on

37 of 51 references.

References · 37

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  8. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  9. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  10. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  11. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  12. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
25 more
  1. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  2. 2017End-to-end Recovery of Human Shape and Posecited by 883
  3. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  4. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  5. 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 635
  6. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  7. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
  8. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  9. 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 417
  10. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
  11. 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
  12. 2020Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Posecited by 248
  13. 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
  14. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
  15. 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
  16. 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
  17. 2019DeepHuman: 3D Human Reconstruction from a Single Imagecited by 182
  18. 2018BodyNet: Volumetric Inference of 3D Human Body Shapescited by 141
  19. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 122
  20. 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
  21. 2024MVDiffusion++: A Dense High-resolution Multi-view Diffusion Model for Single or Sparse-view 3D Object Reconstructioncited by 94
  22. 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
  23. 2023High-fidelity 3D Human Digitization from Single 2K Resolution Imagescited by 70
  24. 2022Revisiting Image Pyramid Structure for High Resolution Salient Object Detectioncited by 36
  25. 2023SyncDreamer for 3D Reconstruction of Endangered Animal Species with NeRF and NeuScited by 2

Built on by

Cited by year

Citing papers per year: 2024: 8; 2025: 4.

12 papers.