Ultraman: Single Image 3D Human Reconstruction with Ultra Speed and Detail
Not on the map. Why?
Abstract (arXiv)
3D human body reconstruction has been a challenge in the field of computer vision. Previous methods are often time-consuming and difficult to capture the detailed appearance of the human body. In this paper, we propose a new method called Ultraman for fast reconstruction of textured 3D human models from a single image. Compared to existing techniques, Ultraman greatly improves the reconstruction speed and accuracy while preserving high-quality texture details. We present a set of new frameworks for human reconstruction consisting of three parts, geometric reconstruction, texture generation and texture mapping. Firstly, a mesh reconstruction framework is used, which accurately extracts 3D human shapes from a single image. At the same time, we propose a method to generate a multi-view consistent image of the human body based on a single image. This is finally combined with a novel texture mapping method to optimize texture details and ensure color consistency during reconstruction. Through extensive experiments and evaluations, we demonstrate the superior performance of Ultraman on various standard datasets. In addition, Ultraman outperforms state-of-the-art methods in terms of human rendering quality and speed. Upon acceptance of the article, we will make the code and data publicly available.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 37 of its 51 references that are in the map. First posted on arXiv 18 Mar 2024.
Builds on
37 of 51 references.
References · 37
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
25 more
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 635
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
- 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 417
- 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2020Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Posecited by 248
- 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
- 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2019DeepHuman: 3D Human Reconstruction from a Single Imagecited by 182
- 2018BodyNet: Volumetric Inference of 3D Human Body Shapescited by 141
- 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 122
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2024MVDiffusion++: A Dense High-resolution Multi-view Diffusion Model for Single or Sparse-view 3D Object Reconstructioncited by 94
- 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
- 2023High-fidelity 3D Human Digitization from Single 2K Resolution Imagescited by 70
- 2022Revisiting Image Pyramid Structure for High Resolution Salient Object Detectioncited by 36
- 2023SyncDreamer for 3D Reconstruction of Endangered Animal Species with NeRF and NeuScited by 2
Built on by
Citing papers per year: 2024: 8; 2025: 4.
12 papers.
- 2024AniGS: Animatable Gaussian Avatar from a Single Image with Inconsistent Gaussian Reconstructioncited by 36
- 2024DRiVE: Diffusion-based Rigging Empowers Generation of Versatile and Expressive Characterscited by 24
- 2024PuzzleAvatar: Assembling 3D Avatars from Personal Albumscited by 16
- 2024Training-Free Model Merging for Multi-target Domain Adaptationcited by 15
- 2025PartRM: Modeling Part-Level Dynamics with Large Cross-State Reconstruction Modelcited by 15
- 2024Idea23D: Collaborative LMM Agents Enable 3D Model Generation from Interleaved Multimodal Inputscited by 12
- 2024GST: Precise 3D Human Body from a Single Image with Gaussian Splatting Transformerscited by 11
- 2024Diffusion-based Visual Anagram as Multi-task Learningcited by 6
- 2024Human-VDM: Learning Single-Image 3D Human Gaussian Splatting from Video Diffusion Modelscited by 5
- 2025LLMsPark: A Benchmark for Evaluating Large Language Models in Strategic Gaming Contextscited by 4
- 2025FB-4D: Spatial-Temporal Coherent Dynamic 3D Content Generation with Feature Bankscited by 3
- 2025SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentationcited by 2
- 2025LLMsPark: A Benchmark for Evaluating Large Language Models in Strategic Gaming Contexts20 Sep 2025
- 2025SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentation8 May 2025
- 2025FB-4D: Spatial-Temporal Coherent Dynamic 3D Content Generation with Feature Banks26 Mar 2025
- 2025PartRM: Modeling Part-Level Dynamics with Large Cross-State Reconstruction Model25 Mar 2025
- 2024Diffusion-based Visual Anagram as Multi-task Learning3 Dec 2024
- 2024AniGS: Animatable Gaussian Avatar from a Single Image with Inconsistent Gaussian Reconstruction3 Dec 2024
- 2024DRiVE: Diffusion-based Rigging Empowers Generation of Versatile and Expressive Characters26 Nov 2024
- 2024GST: Precise 3D Human Body from a Single Image with Gaussian Splatting Transformers6 Sep 2024
- 2024Human-VDM: Learning Single-Image 3D Human Gaussian Splatting from Video Diffusion Models4 Sep 2024
- 2024Training-Free Model Merging for Multi-target Domain Adaptation18 Jul 2024
- 2024PuzzleAvatar: Assembling 3D Avatars from Personal Albums23 May 2024
- 2024Idea23D: Collaborative LMM Agents Enable 3D Model Generation from Interleaved Multimodal Inputs5 Apr 2024