mlsanityData to 13 Oct 2026

Envisage: Diffusion-Based Rhinoplasty Goal Visualization with Mask-Decomposed Evaluation

arXiv 2606.28628 ↗First posted 26 Jun 2026eess.IV cs.CV cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Localized generative editing needs localized evaluation: full-image identity metrics are structurally confounded under hard-composited edits. We present Envisage, a FLUX.1-Fill inpainting reference pipeline for rhinoplasty goal visualization from a single frontal photograph. The pipeline combines 8 rhinoplasty clinical presets (the released framework also includes 8 blepharoplasty and 8 rhytidectomy presets), MediaPipe masks, and hard-mask compositing. The composite preserves outside-mask pixels by construction, so full-face identity scores are dominated by copied pixels rather than by the diffusion backbone. Because full-face identity metrics cannot grade localized edits, we introduce SurgicalScore, a mask-decomposed 0-1 protocol scoring edit direction, edit magnitude, masked LPIPS, realism, and outside-mask preservation; SS_raw assigns 0.919 [0.918, 0.920] to a perfect-predictor control , anchoring the ceiling. On N=211, the paired ArcFace gain (output-to-GT minus input-to-GT) is negative for all methods (Envisage -0.048 smallest, vs. ICEdit -0.139, Kontext -0.242, InstructPix2Pix -0.294; p < 1e-4), with external validation on a 457-pair ASPS/PCA corpus showing a larger negative gap. With SurgicalScore, Envisage achieves the highest score (0.599 [0.579, 0.619]) and leads on both metrics, but the all-negative ArcFace gap shows that full-face identity is poorly aligned with localized surgical accuracy under hard compositing. A 5-seed GT-oracle (an upper bound, not a deployable result) reduces the residual ArcFace gap by 73% (-0.054 to -0.015), with positive output-to-GT gain on 33.9% of cases, indicating candidate-space headroom for a learned ranker. For localized edits, progress should be measured with edit-region fidelity rather than full-face identity metrics. We release Envisage, SurgicalScore, preset definitions, and matched split manifests.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 12 of its 36 references that are in the map. First posted on arXiv 26 Jun 2026.

Builds on

12 of 36 references.

References · 12

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,777
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,082
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,000
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,484
  5. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,323
  6. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,975
  7. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,604
  8. 2024Depth Anything V2cited by 1,399
  9. 2020SER-FIQ: Unsupervised Estimation of Face Image Quality Based on Stochastic Embedding Robustnesscited by 112
  10. 2019Real-time Facial Surface Geometry from Monocular Video on Mobile GPUscited by 73
  11. 2021CR-FIQA: Face Image Quality Assessment by Learning Sample Relative Classifiabilitycited by 69
  12. 2025Automated Assessment of Aesthetic Outcomes in Facial Plastic Surgerycited by 1

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 1.

1 paper.