AIM-Bench: Benchmarking and Improving Affective Image Manipulation via Fine-Grained Hierarchical Control
Not on the map. Why?
Abstract (arXiv)
Affective Image Manipulation (AIM) aims to evoke specific emotions through targeted editing. Current image editing benchmarks primarily focus on object-level modifications in general scenarios, lacking the fine-grained granularity to capture affective dimensions. To bridge this gap, we introduce the first benchmark designed for AIM termed AIM-Bench. This benchmark is built upon a dual-path affective modeling scheme that integrates the Mikels emotion taxonomy with the Valence-Arousal-Dominance framework, enabling high-level semantic and fine-grained continuous manipulation. Through a hierarchical human-in-the-loop workflow, we finally curate 800 high-quality samples covering 8 emotional categories and 5 editing types. To effectively assess performance, we also design a composite evaluation suite combining rule-based and model-based metrics to holistically assess instruction consistency, aesthetics, and emotional expressiveness. Extensive evaluations reveal that current editing models face significant challenges, most notably a prevalent positivity bias, which stemming from inherent imbalances in training data distribution. To tackle this, we propose a scalable data engine utilizing an inverse repainting strategy to construct AIM-40k, a balanced instruction-tuning dataset comprising 40k samples. Concretely, we enhance raw affective images via generative redrawing to establish high-fidelity ground truths, and synthesize input images with divergent emotions and paired precise instructions. Fine-tuning a baseline model on AIM-40k yields a 9.15% relative improvement in overall performance, demonstrating the effectiveness of our AIM-40k. Our data and related code will be made open soon.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 29 of its 34 references that are in the map. First posted on arXiv 12 Apr 2026.
Builds on
29 of 34 references.
References · 29
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2022Diffusion Models in Vision: A Surveycited by 1,015
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2024Long-CLIP: Unlocking the Long-Text Capability of CLIPcited by 300
17 more
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
- 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
- 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
- 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 185
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
- 2023EmoSet: A Large-scale Visual Emotion Dataset with Rich Attributescited by 82
- 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedbackcited by 79
- 2024I2EBench: A Comprehensive Benchmark for Instruction-based Image Editingcited by 63
- 2025DreamOmni2: Multimodal Instruction-based Editing and Generationcited by 38
- 2024EmoGen: Emotional Image Content Generation with Text-to-Image Diffusion Modelscited by 37
- 2024EmoEdit: Evoking Emotions through Image Manipulationcited by 30
- 2025Affective Image Editing: Shaping Emotional Factors via Text Descriptionscited by 12
- 2021AffectGAN: Affect-Based Generative Art Driven by Semanticscited by 10
- 2025Improving Multimodal Sentiment Analysis via Modality Optimization and Dynamic Primary Modality Selectioncited by 7
- 2023Affective Video Content Analysis: Decade Review and New Perspectivescited by 5
Built on by
Citing papers per year: 2026: 2.
2 papers.