mlsanityData to 14 Oct 2026

Towards High-fidelity Head Blending with Chroma Keying for Industrial Applications

arXiv 2411.00652 ↗First posted 1 Nov 2024cs.CV cs.GR cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

We introduce an industrial Head Blending pipeline for the task of seamlessly integrating an actor's head onto a target body in digital content creation. The key challenge stems from discrepancies in head shape and hair structure, which lead to unnatural boundaries and blending artifacts. Existing methods treat foreground and background as a single task, resulting in suboptimal blending quality. To address this problem, we propose CHANGER, a novel pipeline that decouples background integration from foreground blending. By utilizing chroma keying for artifact-free background generation and introducing Head shape and long Hair augmentation (H2 augmentation) to simulate a wide range of head shapes and hair styles, CHANGER improves generalization on innumerable various real-world cases. Furthermore, our Foreground Predictive Attention Transformer (FPAT) module enhances foreground blending by predicting and focusing on key head and body regions. Quantitative and qualitative evaluations on benchmark datasets demonstrate that our CHANGER outperforms state-of-the-art methods, delivering high-fidelity, industrial-grade results.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 27 references that are in the map. First posted on arXiv 1 Nov 2024.

Builds on

20 of 27 references.

References · 20

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  7. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
  8. 2018VoxCeleb2: Deep Speaker Recognitioncited by 875
  9. 2017VoxCeleb: a large-scale speaker identification datasetcited by 732
  10. 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
  11. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
  12. 2021ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biasescited by 484
8 more
  1. 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
  2. 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
  3. 2020Cross-domain Correspondence Learning for Exemplar-based Image Translationcited by 116
  4. 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
  5. 2023BlendFace: Re-designing Identity Encoders for Face-Swappingcited by 66
  6. 2022Region-Aware Face Swappingcited by 45
  7. 2022Few-Shot Head Swapping in the Wildcited by 21
  8. 2022OAMixer: Object-aware Mixing Layer for Vision Transformerscited by 4

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.