Optimizing ID Consistency in Multimodal Large Models: Facial Restoration via Alignment, Entanglement, and Disentanglement
Not on the map. Why?
Abstract (arXiv)
Multimodal editing large models have demonstrated powerful editing capabilities across diverse tasks. However, a persistent and long-standing limitation is the decline in facial identity (ID) consistency during realistic portrait editing. Due to the human eye's high sensitivity to facial features, such inconsistency significantly hinders the practical deployment of these models. Current facial ID preservation methods struggle to achieve consistent restoration of both facial identity and edited element IP due to Cross-source Distribution Bias and Cross-source Feature Contamination. To address these issues, we propose EditedID, an Alignment-Disentanglement-Entanglement framework for robust identity-specific facial restoration. By systematically analyzing diffusion trajectories, sampler behaviors, and attention properties, we introduce three key components: 1) Adaptive mixing strategy that aligns cross-source latent representations throughout the diffusion process. 2) Hybrid solver that disentangles source-specific identity attributes and details. 3) Attentional gating mechanism that selectively entangles visual elements. Extensive experiments show that EditedID achieves state-of-the-art performance in preserving original facial ID and edited element IP consistency. As a training-free and plug-and-play solution, it establishes a new benchmark for practical and reliable single/multi-person facial identity restoration in open-world settings, paving the way for the deployment of multimodal editing large models in real-person editing scenarios. The code is available at https://github.com/NDYBSNDY/EditedID.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 45 references that are in the map. First posted on arXiv 21 Feb 2026.
Builds on
33 of 45 references.
References · 33
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2025Qwen-Image Technical Reportcited by 973
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
21 more
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023Emergent Correspondence from Image Diffusioncited by 437
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylizationcited by 251
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
- 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 193
- 2022DifFace: Blind Face Restoration with Diffused Error Contractioncited by 96
- 2024MambaIRv2: Attentive State Space Restorationcited by 90
- 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Controlcited by 66
- 2024DreamMatcher: Appearance Matching Self-Attention for Semantically-Consistent Text-to-Image Personalizationcited by 60
- 2022FaceDancer: Pose- and Occlusion-Aware High Fidelity Face Swappingcited by 44
- 2016A Formal Evaluation of PSNR as Quality Measurement Parameter for Image Segmentation Algorithmscited by 42
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Modelscited by 35
- 2024Posterior-Mean Rectified Flow: Towards Minimum MSE Photo-Realistic Image Restorationcited by 32
- 2025Universal Image Restoration Pre-training via Degradation Classificationcited by 32
- 2023MEGANE: Morphable Eyeglass and Avatar Networkcited by 24
- 2024Inf-DiT: Upsampling Any-Resolution Image with Memory-Efficient Diffusion Transformercited by 14
- 2025DreamID: High-Fidelity and Fast diffusion-based Face Swapping via Triplet ID Group Learningcited by 10
- 2024Face Swap via Diffusion Modelcited by 3
- 2025Pose-Star: Anatomy-Aware Editing for Open-World Fashion Imagescited by 2
- 2025Undertrained Image Reconstruction for Realistic Degradation in Blind Image Super-Resolutioncited by 1
Built on by
Not cited yet.