From Engineering Diagrams to Graphs: Digitizing P&IDs with Transformers
Not on the map. Why?
Abstract (arXiv)
Digitizing engineering diagrams like Piping and Instrumentation Diagrams (P&IDs) plays a vital role in maintainability and operational efficiency of process and hydraulic systems. Previous methods typically decompose the task into separate steps such as symbol detection and line detection, which can limit their ability to capture the structure in these diagrams. In this work, a transformer-based approach leveraging the Relationformer that addresses this limitation by jointly extracting symbols and their interconnections from P&IDs is introduced. To evaluate our approach and compare it to a modular digitization approach, we present the first publicly accessible benchmark dataset for P&ID digitization, annotated with graph-level ground truth. Experimental results on real-world diagrams show that our method significantly outperforms the modular baseline, achieving over 25% improvement in edge detection accuracy. This research contributes a reproducible evaluation framework and demonstrates the effectiveness of transformer models for structural understanding of complex engineering diagrams. The dataset is available under https://zenodo.org/records/14803338.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 14 of its 50 references that are in the map. First posted on arXiv 21 Nov 2024.
Builds on
14 of 50 references.
References · 14
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2019Character Region Awareness for Text Detectioncited by 278
- 2018SpaceNet: A Remote Sensing Dataset and Challenge Seriescited by 179
- 2021Benchmarking Detection Transfer Learning with Vision Transformerscited by 131
- 2021SGTR: End-to-end Scene Graph Generation with Transformercited by 103
- 2022Scene Graph Generation: A Comprehensive Surveycited by 73
- 2022Relationformer: A Unified Framework for Image-to-Graph Generationcited by 67
- 2020Sat2Graph: Road Graph Extraction through Graph-Tensor Encodingcited by 55
- 2019Image-Conditioned Graph Generation for Road Network Extractioncited by 17
- 2019Automatic Information Extraction from Piping and Instrumentation Diagramscited by 9
- 2022Rethinking the Evaluation of Unbiased Scene Graph Generationcited by 9
- 2021Digitize-PID: Automatic Digitization of Piping and Instrumentation Diagramscited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026Enginuity: Building an Open Multi-Domain Dataset of Complex Engineering Diagramscited by 1
- 2026Simulation Code Generation for Fluid Systems using Large Language Models: Benchmarking Models and Prompting Strategiescited by 1
- 2025A document is worth a structured record: Principled inductive bias design for document recognitioncited by 0
- 2026FlowExtract: Procedural Knowledge Extraction from Maintenance Flowchartscited by 0
- 2026SynthPID: P&ID digitization from Topology-Preserving Synthetic Datacited by 0
- 2026Simulation Code Generation for Fluid Systems using Large Language Models: Benchmarking Models and Prompting Strategies31 Jul 2026
- 2026SynthPID: P&ID digitization from Topology-Preserving Synthetic Data15 Apr 2026
- 2026FlowExtract: Procedural Knowledge Extraction from Maintenance Flowcharts8 Apr 2026
- 2026Enginuity: Building an Open Multi-Domain Dataset of Complex Engineering Diagrams19 Jan 2026
- 2025A document is worth a structured record: Principled inductive bias design for document recognition11 Jul 2025