InsHuman: Towards Natural and Identity-Preserving Human Insertion
Not on the map. Why?
Abstract (arXiv)
Human insertion aims to naturally place specific individuals into a target background. Although existing image editing models may have such ability, they often produce failure cases, including inappropriate human pose in new background, inconsistent number of people, and modified facial identity. Moreover, publicly available human datasets often lack full-body portraits and realistic physical interaction between humans and their background. To address these challenges, we propose InsHuman for natural and identity-preserving human insertion. Specifically, we propose Human-Background Adaptive Fusion (HBAF), which detects foreground humans to obtain a binary mask and applies region-aware weighting to align the human regions between predicted and ground-truth latents, ensuring the person's pose, count, and overall appearance are coherently adapted to the target background.We further propose Face-to-Face ID-Preserving (FFIP), which detects and matches faces between the generated image and the source image in terms of face recognition features to enforce identity consistency for each face.In addition, we propose Bidirectional Data Pairing (BDP) strategy to construct BDP-InsHuman, a high-quality dataset with realistic human-background interactions. Experiments demonstrate that InsHuman achieves significant improvements in generating plausible images while keeping human identity unchanged.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 44 of its 62 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
44 of 62 references.
References · 44
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
32 more
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2025Qwen-Image Technical Reportcited by 973
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
- 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
- 2025YOLOv12: Attention-Centric Real-Time Object Detectorscited by 300
- 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
- 2018CrowdHuman: A Benchmark for Detecting Human in a Crowdcited by 283
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 229
- 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Compositioncited by 182
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
- 2025HunyuanImage 3.0 Technical Reportcited by 138
- 2023HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generationcited by 104
- 2025Insert Anything: Image Insertion via In-Context Editing in DiTcited by 61
- 2023Putting People in Their Place: Affordance-Aware Human Insertion into Scenescited by 53
- 2025VideoAnydoor: High-fidelity Video Object Insertion with Precise Motion Controlcited by 42
- 2025DreamOmni2: Multimodal Instruction-based Editing and Generationcited by 35
- 2021TISE: Bag of Metrics for Text-to-Image Synthesis Evaluationcited by 13
- 2024Text2Place: Affordance-aware Text Guided Human Placementcited by 11
- 2018UNIQUE: Unsupervised Image Quality Estimationcited by 9
- 2025MultiHuman-Testbench: Benchmarking Image Generation for Multiple Humanscited by 8
- 2025Teleportraits: Training-Free People Insertion into Any Scenecited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.