mlsanityData to 7 Oct 2026

Benchmarking Deep Learning Approaches for AEC Engineering Drawing Layout Detection and Information Extraction

arXiv 2607.18997 ↗First posted 21 Jul 2026cs.CV cs.CE cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Information Extraction (IE) from Architecture, Engineering, and Construction (AEC) drawings remains hindered by manual inefficiency, while Layout Detection, a vital 'middleware' organizing graphical and textual hierarchies, is underexplored. General document layout models, optimized for text-centric content, lack validation on engineering drawings. This study constructs a custom AEC-specific layouts dataset and benchmarks five deep learning architectures. RF-DETR achieves state-of-the-art performance with an mAP50 of 0.949, while the Vision-Language Model Qwen3-VL attains a leading F1-score of 0.911. Conversely, models pre-trained on general document datasets suffer from "domain interference", causing performance degradation. This establishes a robust technical foundation for automated IE in AEC.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 27 references that are in the map. First posted on arXiv 21 Jul 2026.

Builds on

18 of 27 references.

References · 18

  1. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  2. 2025Qwen3-VL Technical Reportcited by 2,534
  3. 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
  4. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
  5. 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 406
  6. 2021OCR-free Document Understanding Transformercited by 400
  7. 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
  8. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 345
  9. 2025YOLOv12: Attention-Centric Real-Time Object Detectorscited by 300
  10. 2022DocLayNet: A Large Human-Annotated Dataset for Document-Layout Analysiscited by 146
  11. 2024DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perceptioncited by 80
  12. 2021LayoutReader: Pre-training of Text and Layout for Reading Order Detectioncited by 79
6 more
  1. 2025RF-DETR: Neural Architecture Search for Real-Time Detection Transformerscited by 70
  2. 2024Fine-Tuning Vision-Language Model for Automated Engineering Drawing Information Extractioncited by 18
  3. 2025A Multi-Stage Hybrid Framework for Automated Interpretation of Multi-View Engineering Drawings Using Vision Language Modelcited by 6
  4. 2022Component Segmentation of Engineering Drawings Using Graph Convolutional Networkscited by 5
  5. 2025Graph-based Document Structure Analysiscited by 4
  6. 2025Title block detection and information extraction for enhanced building drawings searchcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AECV-Bench: Benchmarking Multimodal Models on Architectural and Engineering Drawings Understanding
  2. 2026K-OPSD: Verifiable On-Policy Self-Distillation for Post-Training Vision-Language Models on AEC Drawings
  3. 2025From Drawings to Decisions: A Hybrid Vision-Language Framework for Parsing 2D Engineering Drawings into Structured Manufacturing Knowledge
  4. 2026DrawingVQA: A Real-World Benchmark for Multi-Depth Visual-Textual Reasoning on Construction Drawings
  5. 2026Learning to Ground Before Reading: Unified PCB Engineering Drawing Parsing with Compact Vision-Language Models
  6. 2026BLUEPRINT Rebuilding a Legacy: Multimodal Retrieval for Complex Engineering Drawings and Documents
  7. 2026MMArch: Benchmarking Multimodal Reasoning Grounded in Architectural Evidence
  8. 2026Enginuity: A Dataset and Benchmark for Vision-Language Understanding of Engineering Diagrams