Blur2Sharp: Human Novel Pose and View Synthesis with Generative Prior Refinement
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
The creation of lifelike human avatars capable of realistic pose variation and viewpoint flexibility remains a fundamental challenge in computer vision and graphics. Current approaches typically yield either geometrically inconsistent multi-view images or sacrifice photorealism, resulting in blurry outputs under diverse viewing angles and complex motions. To address these issues, we propose Blur2Sharp, a novel framework integrating 3D-aware neural rendering and diffusion models to generate sharp, geometrically consistent novel-view images from only a single reference view. Our method employs a dual-conditioning architecture: initially, a Human NeRF model generates geometrically coherent multi-view renderings for target poses, explicitly encoding 3D structural guidance. Subsequently, a diffusion model conditioned on these renderings refines the generated images, preserving fine-grained details and structural fidelity. We further enhance visual quality through hierarchical feature fusion, incorporating texture, normal, and semantic priors extracted from parametric SMPL models to simultaneously improve global coherence and local detail accuracy. Extensive experiments demonstrate that Blur2Sharp consistently surpasses state-of-the-art techniques in both novel pose and view generation tasks, particularly excelling under challenging scenarios involving loose clothing and occlusions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 38 of its 45 references that are in the map. First posted on arXiv 9 Dec 2025.
Builds on
38 of 45 references.
Closest ancestors · 5
Same direction, newest first
- 2024MagicMan: Generative Novel View Synthesis of Humans with 3D-Aware Diffusion and Iterative Refinement26 Aug
- 2024Improving Diffusion Models for Authentic Virtual Try-on in the Wild8 Mar
- 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion12 Apr
- 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
Other references · 33
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 272
21 more
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 238
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 198
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 144
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 117
- 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 117
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 102
- 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
- 2024IDOL: Instant Photorealistic 3D Human Creation from a Single Imagecited by 55
- 2023MVHumanNet: A Large-scale Dataset of Multi-view Daily Dressing Human Capturescited by 54
- 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priorscited by 54
- 2022MPS-NeRF: Generalizable 3D Human Rendering from Multiview Imagescited by 53
- 2024Generalizable Human Gaussians for Sparse View Synthesiscited by 40
- 2024AniGS: Animatable Gaussian Avatar from a Single Image with Inconsistent Gaussian Reconstructioncited by 36
- 2024DisPose: Disentangling Pose Guidance for Controllable Human Image Animationcited by 35
- 2023SMPLitex: A Generative Model and Dataset for 3D Human Texture Estimation from Single Imagecited by 30
- 2024CharacterGen: Efficient 3D Character Generation from Single Images with Multi-View Pose Canonicalizationcited by 28
- 2022Neural Capture of Animatable 3D Human from Monocular Videocited by 22
- 2023ActorsNeRF: Animatable Few-shot Human Rendering with Generalizable NeRFscited by 21
- 2024GST: Precise 3D Human Body from a Single Image with Gaussian Splatting Transformerscited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025GAS: Generative Avatar Synthesis from a Single Image
- 20243D2-Actor: Learning Pose-Conditioned 3D-Aware Denoiser for Realistic Gaussian Avatar Modeling
- 2025HumanGif: Single-View Human Diffusion with Generative Prior
- 2025ViSA: 3D-Aware Video Shading for Real-Time Upper-Body Avatar Creation
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models
- 2026DeblurNVS: Geometric Latent Diffusion for Novel View Synthesis from Sparse Motion-Blurred Images
- 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creation
- 2023MVHuman: Tailoring 2D Diffusion with Multi-view Sampling For Realistic 3D Human Generation