FED-Bench: A Cross-Granular Benchmark for Disentangled Evaluation of Facial Expression Editing
Not on the map. Why?
Abstract (arXiv)
Facial expression image editing requires fine-grained control to strictly preserve human identity and background while precisely manipulating expression. However, existing editing benchmarks primarily focus on general scenarios, lacking high-quality facial images and corresponding editing instructions. Furthermore, current evaluation metrics exhibit systemic biases in this task, often favoring lazy editing or overfit editing. To bridge these gaps, we propose FED-Bench, a comprehensive benchmark featuring rigorous testing and an accurate evaluation suite. First, we carefully construct a benchmark of 747 triplets through a cascaded and scalable pipeline, each comprising an original image, an editing instruction, and a ground-truth image for precise evaluation. Second, we introduce FED-Score, a cross-granularity evaluation protocol that disentangles assessment into three dimensions: Alignment for verifying instruction following, Fidelity for testing image quality and identity preservation, and Relative Expression Gain for quantifying the magnitude of expression changes, effectively mitigating the aforementioned evaluation biases. Third, we benchmark 18 image editing models, revealing that current approaches struggle to simultaneously achieve high fidelity and accurate expression manipulation, with fine-grained instruction following identified as the primary bottleneck. Finally, leveraging the scalable characteristic of introduced benchmark engine, we provide a 20k+ in-the-wild facial training set and demonstrate its effectiveness by fine-tuning a baseline model that achieves significant performance gains. Our benchmark and related code will be made publicly open soon.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 42 of its 53 references that are in the map. First posted on arXiv 31 Mar 2026.
Builds on
42 of 53 references.
References · 42
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2016Improved Techniques for Training GANscited by 2,938
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
30 more
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2024OmniGen: Unified Image Generationcited by 388
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 229
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 196
- 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 191
- 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 182
- 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 174
- 2020DFEW: A Large-Scale Database for Recognizing Dynamic Facial Expressions in the Wildcited by 128
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 97
- 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedbackcited by 78
- 2024I2EBench: A Comprehensive Benchmark for Instruction-based Image Editingcited by 61
- 2025SeedEdit 3.0: Fast and High-Quality Generative Image Editingcited by 52
- 2025DreamOmni2: Multimodal Instruction-based Editing and Generationcited by 35
- 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Modelscited by 24
- 2026TextPecker: Rewarding Structural Anomaly Quantification for Enhancing Visual Text Renderingcited by 14
- 2025ViC-Bench: Benchmarking Visual-Interleaved Chain-of-Thought Capability in MLLMs with Free-Style Intermediate State Representationscited by 11
- 2025Balancing Preservation and Modification: A Region and Semantic Aware Metric for Instruction-Based Image Editingcited by 9
- 2025Towards Comprehensive Interactive Change Understanding in Remote Sensing: A Large-scale Dataset and Dual-granularity Enhanced VLMcited by 8
- 2024MagicFace: Training-free Universal-Style Human Image Customized Synthesiscited by 7
- 2025Improving Multimodal Sentiment Analysis via Modality Optimization and Dynamic Primary Modality Selectioncited by 6
- 2025Scalable Audio-Visual Masked Autoencoders for Efficient Affective Video Facial Analysiscited by 5
- 2025LaTo: Landmark-tokenized Diffusion Transformer for Fine-grained Human Face Editingcited by 5
- 2025Beyond Pixel Simulation: Pathology Image Generation via Diagnostic Semantic Tokens and Prototype Controlcited by 3
- 2023Towards Emotion Analysis in Short-form Videos: A Large-Scale Dataset and Baselinecited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.