Toward Trustworthy Portrait Editing: Evaluation of Demographic Misrepresentation in I2I Models
Not on the map. Why?
Abstract (arXiv)
Instruction-guided image-to-image (I2I) editors are increasingly used in consumer and professional visual workflows, where trustworthiness depends not only on prompt compliance but also on equitable preservation of identity-relevant attributes. We formalize two failure modes: Soft Erasure, where requested edits are weakly realized or silently suppressed, and Stereotype Replacement, where edits introduce unrequested, stereotype-consistent demographic attributes. Using a controlled benchmark of 5,040 edited portraits, we evaluate these failures across three recent open-weight editors with vision-language model scoring and human evaluation. Our results show that identity-preservation failures are pervasive and demographically uneven. In particular, 62--71% of outputs exhibit skin lightening, with Indian and Black source portraits affected at 72--75%, compared with 44% for White source portraits, indicating output-level drift toward lighter or more White-presenting appearances when identity constraints are underspecified. In a mitigation case study, prompt-level appearance constraints reduce race-change scores for non-White source portraits by up to 1.48 points, while leaving White source portraits largely unchanged, without modifying model weights. These findings show that identity preservation is not a uniform property of I2I portrait editing systems, but an unevenly distributed trustworthiness failure with direct social consequences. At deployment scale, such silent distortions can shape AI-mediated self-representation and reinforce representational disparities. We introduce a controlled audit protocol for fairness-aware evaluation and governance of generative editing systems. Project page: https://seochan99.github.io/i2i-demographic-bias
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 40 references that are in the map. First posted on arXiv 18 Feb 2026.
Builds on
20 of 40 references.
References · 20
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2025Qwen-Image Technical Reportcited by 973
- 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 657
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
- 2024OR-Bench: An Over-Refusal Benchmark for Large Language Modelscited by 222
- 2024Multi-Reward as Condition for Instruction-based Image Editingcited by 20
- 2024SCoFT: Self-Contrastive Fine-Tuning for Equitable Image Generationcited by 19
- 2024New Job, New Gender? Measuring the Social Bias in Image Generation Modelscited by 15
- 2023Perceptions and Realities of Text-to-Image Generationcited by 5
- 2025InstaFace: Identity-Preserving Facial Editing with Single Image Inferencecited by 5
- 2025OVERT: A Benchmark for Over-Refusal Evaluation on Text-to-Image Modelscited by 5
8 more
- 2025Bias Amplification in Stable Diffusion's Representation of Stigma Through Skin Tones and Their Homogeneitycited by 5
- 2025DermDiff: Generative Diffusion Model for Mitigating Racial Biases in Dermatology Diagnosiscited by 4
- 2025Exposing Blindspots: Cultural Bias Evaluation in Generative Image Modelscited by 4
- 2025Hidden Bias in the Machine: Stereotypes in Text-to-Image Modelscited by 2
- 2025TrueSkin: Towards Fair and Accurate Skin Tone Recognition and Generationcited by 2
- 2025Beyond the Prompt: Gender Bias in Text-to-Image Models, with a Case Study on Hospital Professionscited by 2
- 2025T2IBias: Uncovering Societal Bias Encoded in the Latent Space of Text-to-Image Generative Modelscited by 2
- 2025The Digital Mirror: Gender Bias and Occupational Stereotypes in AI-Generated Imagescited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Cross-Branch Conflict as a Shield: Safeguarding Facial Identities in Unified Multimodal Image Editing
- 2024Edit Away and My Face Will not Stay: Personal Biometric Defense against Malicious Generative Editing
- 2026Human-Aligned MLLM Judges for Fine-Grained Image Editing Evaluation: A Benchmark, Framework, and Analysis
- 2025IC-Portrait: In-Context Matching for View-Consistent Personalized Portrait
- 2025Beyond the Pixels: VLM-based Evaluation of Identity Preservation in Reference-Guided Synthesis
- 2025Generating Synthetic Data via Augmentations for Improved Facial Resemblance in DreamBooth and InstantID
- 2026Taming I2V models for Image HOI Editing: A Cognitive Benchmark and Agentic Self-Correcting Framework
- 2024Image-Perfect Imperfections: Safety, Bias, and Authenticity in the Shadow of Text-To-Image Model Evolution