Beyond Pixels: Vector-to-Graph Transformation for Reliable Schematic Auditing
On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) have shown remarkable progress in visual understanding, yet they suffer from a critical limitation: structural blindness. Even state-of-the-art models fail to capture topology and symbolic logic in engineering schematics, as their pixel-driven paradigm discards the explicit vector-defined relations needed for reasoning. To overcome this, we propose a Vector-to-Graph (V2G) pipeline that converts CAD diagrams into property graphs where nodes represent components and edges encode connectivity, making structural dependencies explicit and machine-auditable. On a diagnostic benchmark of electrical compliance checks, V2G yields large accuracy gains across all error categories, while leading MLLMs remain near chance level. These results highlight the systemic inadequacy of pixel-based methods and demonstrate that structure-aware representations provide a reliable path toward practical deployment of multimodal AI in engineering domains. To facilitate further research, we release our benchmark and implementation at https://github.com/gm-embodied/V2G-Audit.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 12 of its 21 references that are in the map. First posted on arXiv 12 Feb 2026.
Builds on
12 of 21 references.
References · 12
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
- 2020Object-Centric Learning with Slot Attentioncited by 865
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
- 2017Graph Signal Processing: Overview, Challenges and Applicationscited by 409
- 2023What's "up" with vision-language models? Investigating their struggle with spatial reasoningcited by 245
- 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Modelscited by 111
- 2024Do Vision-Language Models Really Understand Visual Language?cited by 29
- 2025Scaling Vision Pre-Training to 4K Resolutioncited by 26
- 2023Systematic Visual Reasoning through Object-Centric Relational Abstractioncited by 19
- 2024HiRes-LLaVA: Restoring Fragmentation Input in High-Resolution Large Vision-Language Modelscited by 16
- 2025CIRCUIT: A Benchmark for Circuit Interpretation and Reasoning Capabilities of LLMscited by 11
- 2025The Power of Graph Signal Processing for Chip Placement Accelerationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026OmniSch: A Multimodal PCB Schematic Benchmark For Structured Diagram Visual Reasoning
- 2025CircuitSense: A Hierarchical MLLM Benchmark Bridging Visual Comprehension and Symbolic Reasoning in Engineering Design Process
- 2026From Mirage to Grounding: Towards Reliable Multimodal Circuit-to-Verilog Code Generation
- 2026MMArch: Benchmarking Multimodal Reasoning Grounded in Architectural Evidence
- 2026DiagramNet: An End-to-End Recognition Framework and Dataset for Non-Standard System-Level Diagrams
- 2026Enginuity: A Dataset and Benchmark for Vision-Language Understanding of Engineering Diagrams
- 2026BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD
- 2025From Drawings to Decisions: A Hybrid Vision-Language Framework for Parsing 2D Engineering Drawings into Structured Manufacturing Knowledge