mlsanityData to 7 Oct 2026

Localize, Don't Beautify: Client-Side Control of Image-Editing APIs for Cosmetic Surgery Previews

arXiv 2608.02841 ↗First posted 3 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Ask a commercial image editor to preview a cosmetic procedure and it will often change more of the face than the request names: a nose edit can also smooth skin or alter lighting. Existing methods for confining an edit to one region require access to the model's internals, which a public editing API does not expose. We ask how much control is possible from the client side alone. In a pilot benchmark, six commercial editing configurations and one mask-based inpainting model perform facelift-style jaw-neck and rhinoplasty edits at three levels of client-side control: the prompt alone; cutting the edited region out of the response and pasting it back onto the original photograph through a landmark-derived mask (a masked composite); and asking the model itself to inpaint inside the mask where supported. Of 210 attempted edits, 196 could be scored. ArcFace cosine measures identity preservation; a CIELAB pixel-change ratio measures how much change lands inside the requested region rather than a protected facial zone. On the 12 frontal faces the regional metric could score, the masked composite improved localization over the paired prompt-only output by a median of 0.446 (95% face-clustered bootstrap interval 0.421-0.457) while changing the requested region about as much. Editors differed in edit strength versus identity retention, and the one inpainting model we tested did not beat the simple composite. Against each face's input-to-postoperative baseline, no editor moved its outputs closer to the postoperative photograph in identity-embedding terms. This is a study of control, not clinical accuracy: no surgeons rated the outputs, and each condition was generated once. Within that scope, keeping a surgical preview inside its intended region needs no access to the model; a mask and composite on the client enforce it across every editor tested, at low provider cost.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 44 references that are in the map. First posted on arXiv 3 Aug 2026.

Builds on

28 of 44 references.

References · 28

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  4. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  5. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  6. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  7. 2018Model Cards for Model Reportingcited by 1,068
  8. 2025Qwen-Image Technical Reportcited by 973
  9. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  10. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  11. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  12. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
16 more
  1. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  2. 2019MediaPipe: A Framework for Building Perception Pipelinescited by 572
  3. 2022Blended Latent Diffusioncited by 430
  4. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  5. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
  6. 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 229
  7. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 191
  8. 2021Sample and Computation Redistribution for Efficient Face Detectioncited by 86
  9. 2023ImagenHub: Standardizing the evaluation of conditional image generation modelscited by 75
  10. 2024I2EBench: A Comprehensive Benchmark for Instruction-based Image Editingcited by 61
  11. 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generationcited by 57
  12. 2020Attention Mesh: High-fidelity Face Mesh Prediction in Real-timecited by 30
  13. 2025GIE-Bench: Towards Grounded Evaluation for Text-Guided Image Editingcited by 15
  14. 2024Addressing Text Embedding Leakage in Diffusion-based Image Editingcited by 7
  15. 2022Deep Learning-based Facial Appearance Simulation Driven by Surgically Planned Craniomaxillofacial Bony Movementcited by 4
  16. 2026Envisage: Diffusion-Based Rhinoplasty Goal Visualization with Mask-Decomposed Evaluationcited by 1

Built on by

Not cited yet.