Detect Anything in Graphic Design: Element-Level Rewards for Autoregressive Detection
Not on the map. Why?
Abstract (arXiv)
Graphic designs, such as posters, advertisements, and infographics, are an important medium for communicating information and shaping understanding. Unlike natural images, they consist of layered elements with explicit compositional order. However, existing object detection models treat these elements as an unordered set, leaving compositional order unexploited. To address this limitation, we present Detect Anything in Graphic Design (DAD), a model that formulates graphic design detection as compositional deconstruction. It decodes elements in compositional order, using lower-layer elements to better detect higher-layer ones. The key feature of DAD is amodal detection, which predicts the full bounding box of each element, including regions occluded by elements placed above it. Building on this formulation, we propose Element Relative Policy Optimization (EleRPO), which extends GRPO from sequence-level supervision to element-level optimization. EleRPO provides fine-grained training signals that capture how each detected element contributes to overall detection quality, and works synergistically with compositional order to improve detection performance. To support training and evaluation, we build a dataset of 10 million graphic designs. Experiments show that DAD outperforms all baselines and achieves human-level performance in amodal detection, supporting effective image-to-layer decomposition. EleRPO consistently improves over GRPO across nine detection benchmarks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 62 of its 76 references that are in the map. First posted on arXiv 7 Sep 2026.
Builds on
62 of 76 references.
References · 62
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
38 more
- 2021Grounded Language-Image Pre-trainingcited by 1,147
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
- 2022OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Frameworkcited by 742
- 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 613
- 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
- 2019Object Detection in 20 Years: A Surveycited by 528
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 515
- 2023VisionLLM: Large Language Model is also an Open-Ended Decoder for Vision-Centric Taskscited by 499
- 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 498
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
- 2025Process Reinforcement through Implicit Rewardscited by 478
- 2022Unified-IO: A Unified Model for Vision, Language, and Multi-Modal Taskscited by 420
- 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 406
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 403
- 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
- 2021Pix2seq: A Language Modeling Framework for Object Detectioncited by 345
- 2022DETRs with Collaborative Hybrid Assignments Trainingcited by 273
- 2024Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMscited by 265
- 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 175
- 2024VinePPO: Refining Credit Assignment in RL Training of LLMscited by 168
- 2020DocBank: A Benchmark Dataset for Document Layout Analysiscited by 152
- 2022A Unified Sequence Interface for Vision Taskscited by 152
- 2022DETRs with Hybrid Matchingcited by 149
- 2022DocLayNet: A Large Human-Annotated Dataset for Document-Layout Analysiscited by 146
- 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 144
- 2015Semantic Amodal Segmentationcited by 102
- 2021CanvasVAE: Learning to Generate Vector Graphic Documentscited by 93
- 2024DINO-X: A Unified Vision Model for Open-World Object Detection and Understandingcited by 85
- 2024Aesthetic Post-Training Diffusion Models from Generic Preferences with Step-by-step Preference Optimizationcited by 81
- 2024DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perceptioncited by 80
- 2025Segment Policy Optimization: Effective Segment-Level Credit Assignment in RL for Large Language Modelscited by 75
- 2025Detect Anything via Next Point Predictioncited by 66
- 2023PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layoutcited by 60
- 2024Toward Visual Grounding: A Surveycited by 52
- 2016Towards Better Analysis of Deep Convolutional Neural Networkscited by 51
- 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
- 2025Qwen-Image-Layered: Towards Inherent Editability via Layer Decompositioncited by 29
- 2025PP-DocLayout: A Unified Document Layout Detection Model to Accelerate Large-Scale Data Constructioncited by 26
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025InfoDet: A Dataset for Infographic Element Detection
- 2024From Elements to Design: A Layered Approach for Automatic Graphic Design Composition
- 2026Graphic-Design-Bench: A Comprehensive Benchmark for Evaluating AI on Graphic Design Tasks
- 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?
- 2024Design-o-meter: Towards Evaluating and Refining Graphic Designs
- 2024Alfie: Democratising RGBA Image Generation With No
- 2025CreatiDesign: A Unified Multi-Conditional Diffusion Transformer for Creative Graphic Design
- 2026TASTE: A Designer-Annotated Multi-Dimensional Preference Dataset for AI-Generated Graphic Design