mlsanityData to 7 Oct 2026

Detect Anything in Graphic Design: Element-Level Rewards for Autoregressive Detection

arXiv 2609.07072 ↗First posted 7 Sep 2026cs.CV cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Graphic designs, such as posters, advertisements, and infographics, are an important medium for communicating information and shaping understanding. Unlike natural images, they consist of layered elements with explicit compositional order. However, existing object detection models treat these elements as an unordered set, leaving compositional order unexploited. To address this limitation, we present Detect Anything in Graphic Design (DAD), a model that formulates graphic design detection as compositional deconstruction. It decodes elements in compositional order, using lower-layer elements to better detect higher-layer ones. The key feature of DAD is amodal detection, which predicts the full bounding box of each element, including regions occluded by elements placed above it. Building on this formulation, we propose Element Relative Policy Optimization (EleRPO), which extends GRPO from sequence-level supervision to element-level optimization. EleRPO provides fine-grained training signals that capture how each detected element contributes to overall detection quality, and works synergistically with compositional order to improve detection performance. To support training and evaluation, we build a dataset of 10 million graphic designs. Experiments show that DAD outperforms all baselines and achieves human-level performance in amodal detection, supporting effective image-to-layer decomposition. EleRPO consistently improves over GRPO across nine detection benchmarks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 62 of its 76 references that are in the map. First posted on arXiv 7 Sep 2026.

Builds on

62 of 76 references.

References · 62

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  5. 2020End-to-End Object Detection with Transformerscited by 7,384
  6. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  7. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  8. 2025Qwen3-VL Technical Reportcited by 2,534
  9. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  10. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
  11. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
  12. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
38 more
  1. 2021Grounded Language-Image Pre-trainingcited by 1,147
  2. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
  3. 2022OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Frameworkcited by 742
  4. 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 613
  5. 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
  6. 2019Object Detection in 20 Years: A Surveycited by 528
  7. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 515
  8. 2023VisionLLM: Large Language Model is also an Open-Ended Decoder for Vision-Centric Taskscited by 499
  9. 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 498
  10. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
  11. 2025Process Reinforcement through Implicit Rewardscited by 478
  12. 2022Unified-IO: A Unified Model for Vision, Language, and Multi-Modal Taskscited by 420
  13. 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 406
  14. 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 403
  15. 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
  16. 2021Pix2seq: A Language Modeling Framework for Object Detectioncited by 345
  17. 2022DETRs with Collaborative Hybrid Assignments Trainingcited by 273
  18. 2024Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMscited by 265
  19. 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 175
  20. 2024VinePPO: Refining Credit Assignment in RL Training of LLMscited by 168
  21. 2020DocBank: A Benchmark Dataset for Document Layout Analysiscited by 152
  22. 2022A Unified Sequence Interface for Vision Taskscited by 152
  23. 2022DETRs with Hybrid Matchingcited by 149
  24. 2022DocLayNet: A Large Human-Annotated Dataset for Document-Layout Analysiscited by 146
  25. 2024OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotationscited by 144
  26. 2015Semantic Amodal Segmentationcited by 102
  27. 2021CanvasVAE: Learning to Generate Vector Graphic Documentscited by 93
  28. 2024DINO-X: A Unified Vision Model for Open-World Object Detection and Understandingcited by 85
  29. 2024Aesthetic Post-Training Diffusion Models from Generic Preferences with Step-by-step Preference Optimizationcited by 81
  30. 2024DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perceptioncited by 80
  31. 2025Segment Policy Optimization: Effective Segment-Level Credit Assignment in RL for Large Language Modelscited by 75
  32. 2025Detect Anything via Next Point Predictioncited by 66
  33. 2023PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layoutcited by 60
  34. 2024Toward Visual Grounding: A Surveycited by 52
  35. 2016Towards Better Analysis of Deep Convolutional Neural Networkscited by 51
  36. 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
  37. 2025Qwen-Image-Layered: Towards Inherent Editability via Layer Decompositioncited by 29
  38. 2025PP-DocLayout: A Unified Document Layout Detection Model to Accelerate Large-Scale Data Constructioncited by 26

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025InfoDet: A Dataset for Infographic Element Detection
  2. 2024From Elements to Design: A Layered Approach for Automatic Graphic Design Composition
  3. 2026Graphic-Design-Bench: A Comprehensive Benchmark for Evaluating AI on Graphic Design Tasks
  4. 2026Does Synthetic Layered Design Data Benefit Layered Design Decomposition?
  5. 2024Design-o-meter: Towards Evaluating and Refining Graphic Designs
  6. 2024Alfie: Democratising RGBA Image Generation With No
  7. 2025CreatiDesign: A Unified Multi-Conditional Diffusion Transformer for Creative Graphic Design
  8. 2026TASTE: A Designer-Annotated Multi-Dimensional Preference Dataset for AI-Generated Graphic Design