GenScale: A Benchmark for Relative Object Scale in Image Generation and Editing
Not on the map. Why?
Abstract (arXiv)
Modern image generation and editing systems can produce photorealistic, prompt-aligned images, but still often render familiar objects at implausible relative sizes. To measure this failure mode, we introduce GenScale, a benchmark and evaluation protocol for real-world relative object scale in image generation and editing. GenScale contains 900 image-level entries and 1,643 pairwise anchor-target scale relations across common-object generation, human-product generation with metric dimensions, and scale correction from failed generations. We further design a human-calibrated ordinal judge for scalable pairwise scale evaluation. Last but not the least, we introduce Rescale, a model-agnostic post-processing agent for localized scale correction without modifying the source generator. Experiments reveal that state-of-the-art image generators and editors cannot reliably observe relative scale yet, while Rescale consistently improves scale plausibility across generated and edited images. Together, GenScale establishes relative object scale as a distinct, measurable, and actionable capability for image generation systems.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 33 of its 60 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
33 of 60 references.
References · 33
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2016Improved Techniques for Training GANscited by 2,938
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
21 more
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2024Depth Anything V2cited by 1,385
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
- 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 416
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 360
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
- 2024GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generationcited by 130
- 2025Insert Anything: Image Insertion via In-Context Editing in DiTcited by 61
- 2024Commonsense-T2I Challenge: Can Text-to-Image Generation Models Understand Commonsense?cited by 52
- 2024A-Bench: Are LMMs Masters at Evaluating AI-generated Images?cited by 39
- 2024PhyBench: A Physical Commonsense Benchmark for Evaluating Text-to-Image Modelscited by 36
- 2025R2I-Bench: Benchmarking Reasoning-Driven Text-to-Image Generationcited by 31
- 2026Everything in Its Place: Benchmarking Spatial Intelligence of Text-to-Image Modelscited by 14
- 2024T2I-FactualBench: Benchmarking the Factuality of Text-to-Image Models with Knowledge-Intensive Conceptscited by 12
- 2025GenSpace: Benchmarking Spatially-Aware Image Generationcited by 9
- 2025DetailMaster: Can Your Text-to-Image Model Handle Long Prompts?cited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.