mlsanityData to 14 Oct 2026

From Engineering Diagrams to Graphs: Digitizing P&IDs with Transformers

arXiv 2411.13929 ↗First posted 21 Nov 2024cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Digitizing engineering diagrams like Piping and Instrumentation Diagrams (P&IDs) plays a vital role in maintainability and operational efficiency of process and hydraulic systems. Previous methods typically decompose the task into separate steps such as symbol detection and line detection, which can limit their ability to capture the structure in these diagrams. In this work, a transformer-based approach leveraging the Relationformer that addresses this limitation by jointly extracting symbols and their interconnections from P&IDs is introduced. To evaluate our approach and compare it to a modular digitization approach, we present the first publicly accessible benchmark dataset for P&ID digitization, annotated with graph-level ground truth. Experimental results on real-world diagrams show that our method significantly outperforms the modular baseline, achieving over 25% improvement in edge detection accuracy. This research contributes a reproducible evaluation framework and demonstrates the effectiveness of transformer models for structural understanding of complex engineering diagrams. The dataset is available under https://zenodo.org/records/14803338.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 14 of its 50 references that are in the map. First posted on arXiv 21 Nov 2024.

Builds on

14 of 50 references.

References · 14

  1. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  2. 2019Character Region Awareness for Text Detectioncited by 278
  3. 2018SpaceNet: A Remote Sensing Dataset and Challenge Seriescited by 179
  4. 2021Benchmarking Detection Transfer Learning with Vision Transformerscited by 131
  5. 2021SGTR: End-to-end Scene Graph Generation with Transformercited by 103
  6. 2022Scene Graph Generation: A Comprehensive Surveycited by 73
  7. 2022Relationformer: A Unified Framework for Image-to-Graph Generationcited by 67
  8. 2020Sat2Graph: Road Graph Extraction through Graph-Tensor Encodingcited by 55
  9. 2019Image-Conditioned Graph Generation for Road Network Extractioncited by 17
  10. 2019Automatic Information Extraction from Piping and Instrumentation Diagramscited by 9
  11. 2022Rethinking the Evaluation of Unbiased Scene Graph Generationcited by 9
  12. 2021Digitize-PID: Automatic Digitization of Piping and Instrumentation Diagramscited by 6
2 more
  1. 2021OSSR-PID: One-Shot Symbol Recognition in P&ID Sheets using Path Sampling and GCNcited by 2
  2. 2023Instance Segmentation Based Graph Extraction for Handwritten Circuit Diagram Imagescited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.