mlsanityData to 14 Oct 2026

TRACE-Bench: Decomposing and Diagnosing Multi-Reference Image Generation

arXiv 2608.16765 ↗First posted 17 Aug 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Despite recent advances in unified multimodal models for multi-reference image generation, existing benchmarks remain organized around predefined task types (e.g., "subject composition"), which are ill-suited to this combinatorial setting and lead to fragmented coverage, uncontrolled complexity, and little diagnostic value. Recognizing that diverse multi-reference tasks share a common set of atomic operations, we adopt a capability-oriented perspective and formalize four operators: Anchor (f), Disentangle (g), Apply (oplus), and Compose (C). Any multi-reference prompt can then be represented as a compositional formula over these operators, whose structural complexity is quantified by the number of operator slots. Building on this formulation, we construct TRACE-Bench, comprising approximately 1,600 evaluation cases across slot counts 1--8, built from 631 formula templates and around 4,000 reference images spanning diverse artistic styles and real-world subjects. The formula structure directly drives an operator-aligned evaluation protocol for per-capability scoring and a diagnostic tree analysis for recursive failure localization. Evaluating 9 leading models reveals insights invisible to holistic scoring: the primary bottleneck lies in disentanglement (g) and attribute binding (oplus) rather than scene-level composition (C), with even the best model scoring only 0.74 on attribute fidelity. Project page: https://amuseum-whr.github.io/TraceBench

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 59 references that are in the map. First posted on arXiv 17 Aug 2026.

Builds on

30 of 59 references.

References · 30

  1. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  2. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  3. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  4. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  5. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  6. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  7. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  8. 2022GroupViT: Semantic Segmentation Emerges from Text Supervisioncited by 531
  9. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
  10. 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
  11. 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
  12. 2025Emu3.5: Native Multimodal Models are World Learnerscited by 132
18 more
  1. 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 71
  2. 2023DiffusionSeg: Adapting Diffusion Towards Unsupervised Object Discoverycited by 54
  3. 2024ReMamber: Referring Image Segmentation with Mamba Twistercited by 38
  4. 2026FireRed-Image-Edit-1.0 Technical Reportcited by 36
  5. 2025Easier Painting Than Thinking: Can Text-to-Image Models Set the Stage, but Not Direct the Play?cited by 34
  6. 2023AttrSeg: Open-Vocabulary Semantic Segmentation via Attribute Decomposition-Aggregationcited by 29
  7. 2023Multi-Modal Prototypes for Open-World Semantic Segmentationcited by 22
  8. 2026DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editingcited by 14
  9. 2026GEditBench v2: A Human-Aligned Benchmark for General Image Editingcited by 14
  10. 2023Boundary-aware Supervoxel-level Iteratively Refined Interactive 3D Image Segmentation with Multi-agent Reinforcement Learningcited by 13
  11. 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editingcited by 12
  12. 2026MICON-Bench: Benchmarking and Enhancing Multi-Image Context Image Generation in Unified Multimodal Modelscited by 5
  13. 2025Contrast-Unity for Partially-Supervised Temporal Sentence Groundingcited by 4
  14. 2025MoMa: Modulating Mamba for Adapting Image Foundation Models to Video Recognitioncited by 4
  15. 2026MACRO: Advancing Multi-Reference Image Generation with Structured Long-Context Datacited by 4
  16. 2026H2R-Bench: Benchmarking Human-to-Robot Manipulation Video Generation in World Modelscited by 4
  17. 2026GenMask: Adapting DiT for Segmentation via Direct Mask Generationcited by 3
  18. 2026Reason, Then Re-reason: Cross-view Revisiting Improves Spatial Reasoningcited by 2

Built on by

Not cited yet.