Astrolabe: Spherical-Map Guidance Across Diffusion Pipelines for Full-Body Capture from Unconstrained Images
Not on the map. Why?
Abstract (arXiv)
Full-body capture from unconstrained photographs requires global correspondence across arbitrary views, poses, crops, and occlusions. Yet pose, geometry, and foundation features estimated in this setting are too unreliable for dense matching or appearance transfer, while diffusion rectifiers and optimization pipelines expose no common interface for consuming such uncertain correspondence. Our insight is that correspondence need not be locally accurate: its coarse viewpoint and body layout can still organize how a diffusion prior adapts and guides reconstruction. We introduce Astrolabe, a host-portable adapter built on frozen viewpoint-guided spherical maps (SPH). A fixed bounded transform converts SPH into a spatial noise shift, which is matched during prior adaptation and reused during downstream denoising or score-distillation guidance in both pipeline categories. When a rectifier exposes a reference router, the same target/reference SPH additionally supplies coarse compatibility scores to select native appearance features; router-free optimization uses only the shared shift path. Astrolabe therefore follows one SPH--shift--adapt--guide process without dense warping or a learned control branch. Across Puzzle-IOI and 4D-Dress, it improves all reported image metrics in both hosts and all paired Puzzle-IOI geometry metrics; image gains extend to rear views, while 4D-Dress geometry remains stable overall.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 60 references that are in the map. First posted on arXiv 2 Aug 2026.
Builds on
52 of 60 references.
References · 52
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 575
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
38 more
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
- 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
- 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
- 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
- 2023Drivable 3D Gaussian Avatarscited by 120
- 2023HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generationcited by 105
- 2023Human Gaussian Splatting: Real-time Rendering of Animatable Avatarscited by 105
- 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
- 2023ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Renderingcited by 104
- 2024Expressive Whole-Body 3D Gaussian Avatarcited by 89
- 2023AvatarReX: Real-time Expressive Full-body Avatarscited by 84
- 2022Capturing and Animation of Body and Clothing from Monocular Videocited by 83
- 2023X-Avatar: Expressive Human Avatarscited by 66
- 20244D-DRESS: A 4D Dataset of Real-world Human Clothing with Semantic Annotationscited by 54
- 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
- 2024Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesiscited by 48
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Modelscited by 44
- 2023DiffusionAvatars: Deferred Diffusion for High-fidelity 3D Head Avatarscited by 42
- 2023AvatarBooth: High-Quality and Customizable 3D Human Avatar Generationcited by 37
- 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusioncited by 36
- 2023Improving Semantic Correspondence with Viewpoint-Guided Spherical Mapscited by 34
- 2023REC-MV: REconstructing 3D Dynamic Cloth from Monocular Videoscited by 29
- 2024Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Videocited by 25
- 2024Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creationcited by 23
- 2024LayGA: Layered Gaussian Avatars for Animatable Clothing Transfercited by 22
- 2023CaPhy: Capturing Physical Properties for Animatable Human Avatarscited by 20
- 2024PuzzleAvatar: Assembling 3D Avatars from Personal Albumscited by 16
- 2024GRPose: Learning Graph Relations for Human Image Generation with Pose Priorscited by 14
- 2023HAVE-FUN: Human Avatar Reconstruction from Few-Shot Unconstrained Imagescited by 13
- 2024Cross-view Masked Diffusion Transformers for Person Image Synthesiscited by 12
- 2024Stable-Pose: Leveraging Transformers for Pose-Guided Text-to-Image Generationcited by 12
- 2024TKG-DM: Training-free Chroma Key Content Generation Diffusion Modelcited by 11
- 2025TaoAvatar: Real-Time Lifelike Full-Body Talking Avatars for Augmented Reality via 3D Gaussian Splattingcited by 11
- 2025UP2You: Fast Reconstruction of Yourself from Unconstrained Photo Collectionscited by 10
- 2024PICA: Physics-Integrated Clothed Avatarcited by 8
- 2024Controlling Human Shape and Pose in Text-to-Image Diffusion Models via Domain Adaptationcited by 7
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Diffusion Models are Geometry Critics: Single Image 3D Editing Using Pre-Trained Diffusion Priors
- 2026Geometry-Aware Diffusion Guidance via Curvature-Adaptive Tubular Correction
- 2025Adaptive 3D Reconstruction via Diffusion Priors and Forward Curvature-Matching Likelihood Updates
- 2026PointDiT: Pixel-Space Diffusion for Monocular Geometry Estimation
- 2023Diff-PCR: Diffusion-Based Correspondence Searching in Doubly Stochastic Matrix Space for Point Cloud Registration
- 2026ConfCtrl: Enabling Precise Camera Control in Video Diffusion via Confidence-Aware Interpolation
- 2026World Tracing: Generative Pixel-Aligned Geometry Beyond the Visible
- 2026GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesis