UFO: Chain-of-Evaluation for Omni-Condition Alignment in Multi-Modal Image Generation
Not on the map. Why?
Abstract (arXiv)
Multi-modal image generation, particularly subject-driven customization, has garnered growing attention in recent years. Despite the rapid advancement of generative models, their evaluation remains largely lagging. Existing methods, whether embedding-based or Multi-modal Large Language Model (MLLM)-based, evaluate alignment with each modal condition in isolation, which contradicts the simultaneous condition alignment objective of multi-modal image generation, leading to poor consistency with human judgments. To address this challenge, we propose UFO, the first unified framework for omni-condition alignment simultaneous evaluation. Specifically, UFO introduces a novel Atomized Chain-of-Evaluation paradigm, i.e., it first decomposes omni-condition alignment into a sequential chain of fine-grained, disentangled Atomic Evaluation Units (AEUs), categorizes them into distinct modality-relevance classes, and then employs general or dedicated functional calls for accurate verification of different AEU types. Experimental results demonstrate that UFO achieves the highest correlation with human evaluation preferences, delivering an average improvement of 15.25%. Furthermore, we present UFO-Bench, a dedicated benchmark designed to holistically evaluate the performance of existing customization models under the diverse mutual interactions of textual and visual conditions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 31 references that are in the map. First posted on arXiv 11 Sep 2026.
Builds on
24 of 31 references.
References · 24
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2016Improved Techniques for Training GANscited by 2,970
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
- 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
- 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
12 more
- 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
- 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Fillingcited by 95
- 2023ImagenHub: Standardizing the evaluation of conditional image generation modelscited by 77
- 2025AnyEdit: Edit Any Knowledge Encoded in Language Modelscited by 76
- 2025OminiControl2: Efficient Conditioning for Diffusion Transformerscited by 57
- 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewritingcited by 43
- 2024RealCustom: Narrowing Real Text Word for Real-Time Open-Domain Text-to-Image Customizationcited by 39
- 2023DreamEdit: Subject-driven Image Editingcited by 37
- 2025VINCIE: Unlocking In-context Image Editing from Videocited by 17
- 2024RealCustom++: Representing Images as Real Textual Word for Real-Time Customizationcited by 16
- 2025Beyond the Pixels: VLM-based Evaluation of Identity Preservation in Reference-Guided Synthesiscited by 4
- 2026DSH-Bench: A Difficulty- and Scenario-Aware Benchmark with Hierarchical Subject Taxonomy for Subject-Driven Text-to-Image Generationcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026e5-omni: Explicit Cross-modal Alignment for Omni-modal Embeddings
- 2026DynEval: Holistic Evaluations of T2I Generative Models in the Wild
- 2026Can MiniMax-H3 Reason About the Physical World? An Evaluation of Omni-Modal Generative Model
- 2026GMAIL: Generative Modality Alignment for generated Image Learning
- 2025OmniGenBench: A Benchmark for Omnipotent Multimodal Generation across 50+ Tasks
- 2024EVALALIGN: Supervised Fine-Tuning Multimodal LLMs with Human-Aligned Data for Evaluating Text-to-Image Models
- 2023Divide, Evaluate, and Refine: Evaluating and Improving Text-to-Image Alignment with Iterative VQA Feedback
- 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generation