mlsanityData to 7 Oct 2026

PHAC: Promptable Human Amodal Completion

arXiv 2603.14741 ↗First posted 16 Mar 2026cs.CVcited by 0

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Conditional image generation methods are increasingly used in human-centric applications, yet existing human amodal completion (HAC) models offer users limited control over the completed content. Given an occluded person image, they hallucinate invisible regions while preserving visible ones, but cannot reliably incorporate user-specified constraints such as a desired pose or spatial extent. As a result, users often resort to repeatedly sampling the model until they obtain a satisfactory output. Pose-guided person image synthesis (PGPIS) methods allow explicit pose conditioning, but frequently fail to preserve the instance-specific visible appearance and tend to be biased toward the training distribution, even when built on strong diffusion model priors. To address these limitations, we introduce promptable human amodal completion (PHAC), a new task that completes occluded human images while satisfying both visible appearance constraints and multiple user prompts. Users provide simple point-based prompts, such as additional joints for the target pose or bounding boxes for desired regions; these prompts are encoded using ControlNet modules specialized for each prompt type. These modules inject the prompt signals into a pre-trained diffusion model, and we fine-tune only the cross-attention blocks to obtain strong prompt alignment without degrading the underlying generative prior. To further preserve visible content, we propose an inpainting-based refinement module that starts from a slightly noised coarse completion, faithfully preserves the visible regions, and ensures seamless blending at occlusion boundaries. Extensive experiments on the HAC and PGPIS benchmarks show that our approach yields more physically plausible and higher-quality completions, while significantly improving prompt alignment compared with existing amodal completion and pose-guided synthesis methods.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 55 of its 73 references that are in the map. First posted on arXiv 16 Mar 2026.

Builds on

55 of 73 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Stable Diffusion-Based Approach for Human De-Occlusion18 Aug
  2. 2025Multi-focal Conditioned Latent Diffusion for Person Image Synthesis19 Mar
  3. 2024Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesis28 Feb
  4. 2023SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion27 Nov
  5. 2022Person Image Synthesis via Denoising Diffusion Model22 Nov

Other references · 50

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2023Segment Anythingcited by 8,158
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  9. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  10. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  11. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  12. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
38 more
  1. 2014Conditional Generative Adversarial Netscited by 2,152
  2. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
  3. 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
  4. 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
  5. 2022Blended Latent Diffusioncited by 430
  6. 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
  7. 2017Pose Guided Person Image Generationcited by 251
  8. 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
  9. 2017Deformable GANs for Pose-based Human Image Generationcited by 166
  10. 2021Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayerscited by 104
  11. 2015Semantic Amodal Segmentationcited by 102
  12. 2020Self-Supervised Scene De-occlusioncited by 96
  13. 2023PEEKABOO: Interactive Video Generation via Masked-Diffusioncited by 76
  14. 2024pix2gestalt: Amodal Segmentation by Synthesizing Wholescited by 70
  15. 2025PromptHMR: Promptable Human Mesh Recoverycited by 70
  16. 2022Exploring Dual-task Correlation for Pose Guided Person Image Generationcited by 68
  17. 2016Amodal Instance Segmentationcited by 63
  18. 2018Learning to See the Invisible: End-to-End Trainable Amodal Instance Segmentationcited by 62
  19. 2021PISE: Person Image Synthesis and Editing with Decoupled GANcited by 62
  20. 2017SeGAN: Segmenting and Generating the Invisiblecited by 60
  21. 2018Soft-Gated Warping-GAN for Pose-Guided Person Image Synthesiscited by 59
  22. 2021Learning Semantic Person Image Generation by Region-Adaptive Normalizationcited by 44
  23. 2023Amodal Ground Truth and Completion in the Wildcited by 43
  24. 2025SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Imagescited by 41
  25. 2023Amodal Completion via Progressive Mixed Context Diffusioncited by 38
  26. 20223D Interacting Hand Pose Estimation by Hand De-occlusion and Removalcited by 36
  27. 2021Human De-occlusion: Invisible Perception and Recovery for Humanscited by 31
  28. 2019Object-Driven Multi-Layer Scene Decomposition From a Single Imagecited by 26
  29. 2019Visualizing the Invisible: Occluded Vehicle Segmentation and Recoverycited by 24
  30. 2021Visiting the Invisible: Layer-by-Layer Completed Scene Decompositioncited by 23
  31. 2015Amodal Completion and Size Constancy in Natural Scenescited by 21
  32. 2019How to make a pizza: Learning a compositional layer-based GAN modelcited by 21
  33. 2021A Weakly Supervised Amodal Segmenter with Boundary Uncertainty Estimationcited by 21
  34. 2024Object-level Scene Deocclusioncited by 17
  35. 2024MEGA: Masked Generative Autoencoder for Human Mesh Recoverycited by 13
  36. 2023Neural Interactive Keypoint Detectioncited by 12
  37. 2023TAO-Amodal: A Benchmark for Tracking Any Object Amodallycited by 7
  38. 2024WALT3D: Generating Realistic Training Data from Time-Lapse Imagery for Reconstructing Dynamic Objects under Occlusioncited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Giving a Hand to Diffusion Models: a Two-Stage Approach to Improving Conditional Human Image Generation
  2. 2025Jointly Conditioned Diffusion Model for Multi-View Pose-Guided Person Image Synthesis
  3. 2024Synthesizing Moving People with 3D Control
  4. 2026One-Shot Novel View and Pose Human Image Synthesis via 3D Prior Guided Diffusion Model
  5. 2023Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Models
  6. 2024Multi-modal Pose Diffuser: A Multimodal Generative Conditional Pose Prior
  7. 2024Fusion Embedding for Pose-Guided Person Image Synthesis with Diffusion Model
  8. 2025Real-Time Person Image Synthesis Using a Flow Matching Model