mlsanityData to 7 Oct 2026

Toward Trustworthy Portrait Editing: Evaluation of Demographic Misrepresentation in I2I Models

arXiv 2602.16149 ↗First posted 18 Feb 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Instruction-guided image-to-image (I2I) editors are increasingly used in consumer and professional visual workflows, where trustworthiness depends not only on prompt compliance but also on equitable preservation of identity-relevant attributes. We formalize two failure modes: Soft Erasure, where requested edits are weakly realized or silently suppressed, and Stereotype Replacement, where edits introduce unrequested, stereotype-consistent demographic attributes. Using a controlled benchmark of 5,040 edited portraits, we evaluate these failures across three recent open-weight editors with vision-language model scoring and human evaluation. Our results show that identity-preservation failures are pervasive and demographically uneven. In particular, 62--71% of outputs exhibit skin lightening, with Indian and Black source portraits affected at 72--75%, compared with 44% for White source portraits, indicating output-level drift toward lighter or more White-presenting appearances when identity constraints are underspecified. In a mitigation case study, prompt-level appearance constraints reduce race-change scores for non-White source portraits by up to 1.48 points, while leaving White source portraits largely unchanged, without modifying model weights. These findings show that identity preservation is not a uniform property of I2I portrait editing systems, but an unevenly distributed trustworthiness failure with direct social consequences. At deployment scale, such silent distortions can shape AI-mediated self-representation and reinforce representational disparities. We introduce a controlled audit protocol for fairness-aware evaluation and governance of generative editing systems. Project page: https://seochan99.github.io/i2i-demographic-bias

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 40 references that are in the map. First posted on arXiv 18 Feb 2026.

Builds on

20 of 40 references.

References · 20

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2025Qwen-Image Technical Reportcited by 973
  3. 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 657
  4. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  5. 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
  6. 2024OR-Bench: An Over-Refusal Benchmark for Large Language Modelscited by 222
  7. 2024Multi-Reward as Condition for Instruction-based Image Editingcited by 20
  8. 2024SCoFT: Self-Contrastive Fine-Tuning for Equitable Image Generationcited by 19
  9. 2024New Job, New Gender? Measuring the Social Bias in Image Generation Modelscited by 15
  10. 2023Perceptions and Realities of Text-to-Image Generationcited by 5
  11. 2025InstaFace: Identity-Preserving Facial Editing with Single Image Inferencecited by 5
  12. 2025OVERT: A Benchmark for Over-Refusal Evaluation on Text-to-Image Modelscited by 5
8 more
  1. 2025Bias Amplification in Stable Diffusion's Representation of Stigma Through Skin Tones and Their Homogeneitycited by 5
  2. 2025DermDiff: Generative Diffusion Model for Mitigating Racial Biases in Dermatology Diagnosiscited by 4
  3. 2025Exposing Blindspots: Cultural Bias Evaluation in Generative Image Modelscited by 4
  4. 2025Hidden Bias in the Machine: Stereotypes in Text-to-Image Modelscited by 2
  5. 2025TrueSkin: Towards Fair and Accurate Skin Tone Recognition and Generationcited by 2
  6. 2025Beyond the Prompt: Gender Bias in Text-to-Image Models, with a Case Study on Hospital Professionscited by 2
  7. 2025T2IBias: Uncovering Societal Bias Encoded in the Latent Space of Text-to-Image Generative Modelscited by 2
  8. 2025The Digital Mirror: Gender Bias and Occupational Stereotypes in AI-Generated Imagescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Cross-Branch Conflict as a Shield: Safeguarding Facial Identities in Unified Multimodal Image Editing
  2. 2024Edit Away and My Face Will not Stay: Personal Biometric Defense against Malicious Generative Editing
  3. 2026Human-Aligned MLLM Judges for Fine-Grained Image Editing Evaluation: A Benchmark, Framework, and Analysis
  4. 2025IC-Portrait: In-Context Matching for View-Consistent Personalized Portrait
  5. 2025Beyond the Pixels: VLM-based Evaluation of Identity Preservation in Reference-Guided Synthesis
  6. 2025Generating Synthetic Data via Augmentations for Improved Facial Resemblance in DreamBooth and InstantID
  7. 2026Taming I2V models for Image HOI Editing: A Cognitive Benchmark and Agentic Self-Correcting Framework
  8. 2024Image-Perfect Imperfections: Safety, Bias, and Authenticity in the Shadow of Text-To-Image Model Evolution