PHAC: Promptable Human Amodal Completion
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Conditional image generation methods are increasingly used in human-centric applications, yet existing human amodal completion (HAC) models offer users limited control over the completed content. Given an occluded person image, they hallucinate invisible regions while preserving visible ones, but cannot reliably incorporate user-specified constraints such as a desired pose or spatial extent. As a result, users often resort to repeatedly sampling the model until they obtain a satisfactory output. Pose-guided person image synthesis (PGPIS) methods allow explicit pose conditioning, but frequently fail to preserve the instance-specific visible appearance and tend to be biased toward the training distribution, even when built on strong diffusion model priors. To address these limitations, we introduce promptable human amodal completion (PHAC), a new task that completes occluded human images while satisfying both visible appearance constraints and multiple user prompts. Users provide simple point-based prompts, such as additional joints for the target pose or bounding boxes for desired regions; these prompts are encoded using ControlNet modules specialized for each prompt type. These modules inject the prompt signals into a pre-trained diffusion model, and we fine-tune only the cross-attention blocks to obtain strong prompt alignment without degrading the underlying generative prior. To further preserve visible content, we propose an inpainting-based refinement module that starts from a slightly noised coarse completion, faithfully preserves the visible regions, and ensures seamless blending at occlusion boundaries. Extensive experiments on the HAC and PGPIS benchmarks show that our approach yields more physically plausible and higher-quality completions, while significantly improving prompt alignment compared with existing amodal completion and pose-guided synthesis methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 55 of its 73 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
55 of 73 references.
Closest ancestors · 5
Same direction, newest first
- 2025Stable Diffusion-Based Approach for Human De-Occlusion18 Aug
- 2025Multi-focal Conditioned Latent Diffusion for Person Image Synthesis19 Mar
- 2024Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesis28 Feb
- 2023SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion27 Nov
- 2022Person Image Synthesis via Denoising Diffusion Model22 Nov
Other references · 50
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2023Segment Anythingcited by 8,158
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
38 more
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
- 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
- 2022Blended Latent Diffusioncited by 430
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2017Pose Guided Person Image Generationcited by 251
- 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
- 2017Deformable GANs for Pose-based Human Image Generationcited by 166
- 2021Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayerscited by 104
- 2015Semantic Amodal Segmentationcited by 102
- 2020Self-Supervised Scene De-occlusioncited by 96
- 2023PEEKABOO: Interactive Video Generation via Masked-Diffusioncited by 76
- 2024pix2gestalt: Amodal Segmentation by Synthesizing Wholescited by 70
- 2025PromptHMR: Promptable Human Mesh Recoverycited by 70
- 2022Exploring Dual-task Correlation for Pose Guided Person Image Generationcited by 68
- 2016Amodal Instance Segmentationcited by 63
- 2018Learning to See the Invisible: End-to-End Trainable Amodal Instance Segmentationcited by 62
- 2021PISE: Person Image Synthesis and Editing with Decoupled GANcited by 62
- 2017SeGAN: Segmenting and Generating the Invisiblecited by 60
- 2018Soft-Gated Warping-GAN for Pose-Guided Person Image Synthesiscited by 59
- 2021Learning Semantic Person Image Generation by Region-Adaptive Normalizationcited by 44
- 2023Amodal Ground Truth and Completion in the Wildcited by 43
- 2025SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Imagescited by 41
- 2023Amodal Completion via Progressive Mixed Context Diffusioncited by 38
- 20223D Interacting Hand Pose Estimation by Hand De-occlusion and Removalcited by 36
- 2021Human De-occlusion: Invisible Perception and Recovery for Humanscited by 31
- 2019Object-Driven Multi-Layer Scene Decomposition From a Single Imagecited by 26
- 2019Visualizing the Invisible: Occluded Vehicle Segmentation and Recoverycited by 24
- 2021Visiting the Invisible: Layer-by-Layer Completed Scene Decompositioncited by 23
- 2015Amodal Completion and Size Constancy in Natural Scenescited by 21
- 2019How to make a pizza: Learning a compositional layer-based GAN modelcited by 21
- 2021A Weakly Supervised Amodal Segmenter with Boundary Uncertainty Estimationcited by 21
- 2024Object-level Scene Deocclusioncited by 17
- 2024MEGA: Masked Generative Autoencoder for Human Mesh Recoverycited by 13
- 2023Neural Interactive Keypoint Detectioncited by 12
- 2023TAO-Amodal: A Benchmark for Tracking Any Object Amodallycited by 7
- 2024WALT3D: Generating Realistic Training Data from Time-Lapse Imagery for Reconstructing Dynamic Objects under Occlusioncited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Giving a Hand to Diffusion Models: a Two-Stage Approach to Improving Conditional Human Image Generation
- 2025Jointly Conditioned Diffusion Model for Multi-View Pose-Guided Person Image Synthesis
- 2024Synthesizing Moving People with 3D Control
- 2026One-Shot Novel View and Pose Human Image Synthesis via 3D Prior Guided Diffusion Model
- 2023Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Models
- 2024Multi-modal Pose Diffuser: A Multimodal Generative Conditional Pose Prior
- 2024Fusion Embedding for Pose-Guided Person Image Synthesis with Diffusion Model
- 2025Real-Time Person Image Synthesis Using a Flow Matching Model