mlsanityData to 7 Oct 2026

Beyond Pixels: Vector-to-Graph Transformation for Reliable Schematic Auditing

arXiv 2602.11678 ↗First posted 12 Feb 2026cs.AI cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection

Abstract (arXiv)

Multimodal Large Language Models (MLLMs) have shown remarkable progress in visual understanding, yet they suffer from a critical limitation: structural blindness. Even state-of-the-art models fail to capture topology and symbolic logic in engineering schematics, as their pixel-driven paradigm discards the explicit vector-defined relations needed for reasoning. To overcome this, we propose a Vector-to-Graph (V2G) pipeline that converts CAD diagrams into property graphs where nodes represent components and edges encode connectivity, making structural dependencies explicit and machine-auditable. On a diagnostic benchmark of electrical compliance checks, V2G yields large accuracy gains across all error categories, while leading MLLMs remain near chance level. These results highlight the systemic inadequacy of pixel-based methods and demonstrate that structure-aware representations provide a reliable path toward practical deployment of multimodal AI in engineering domains. To facilitate further research, we release our benchmark and implementation at https://github.com/gm-embodied/V2G-Audit.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 12 of its 21 references that are in the map. First posted on arXiv 12 Feb 2026.

Builds on

12 of 21 references.

References · 12

  1. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
  2. 2020Object-Centric Learning with Slot Attentioncited by 865
  3. 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
  4. 2017Graph Signal Processing: Overview, Challenges and Applicationscited by 409
  5. 2023What's "up" with vision-language models? Investigating their struggle with spatial reasoningcited by 245
  6. 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Modelscited by 111
  7. 2024Do Vision-Language Models Really Understand Visual Language?cited by 29
  8. 2025Scaling Vision Pre-Training to 4K Resolutioncited by 26
  9. 2023Systematic Visual Reasoning through Object-Centric Relational Abstractioncited by 19
  10. 2024HiRes-LLaVA: Restoring Fragmentation Input in High-Resolution Large Vision-Language Modelscited by 16
  11. 2025CIRCUIT: A Benchmark for Circuit Interpretation and Reasoning Capabilities of LLMscited by 11
  12. 2025The Power of Graph Signal Processing for Chip Placement Accelerationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026OmniSch: A Multimodal PCB Schematic Benchmark For Structured Diagram Visual Reasoning
  2. 2025CircuitSense: A Hierarchical MLLM Benchmark Bridging Visual Comprehension and Symbolic Reasoning in Engineering Design Process
  3. 2026From Mirage to Grounding: Towards Reliable Multimodal Circuit-to-Verilog Code Generation
  4. 2026MMArch: Benchmarking Multimodal Reasoning Grounded in Architectural Evidence
  5. 2026DiagramNet: An End-to-End Recognition Framework and Dataset for Non-Standard System-Level Diagrams
  6. 2026Enginuity: A Dataset and Benchmark for Vision-Language Understanding of Engineering Diagrams
  7. 2026BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD
  8. 2025From Drawings to Decisions: A Hybrid Vision-Language Framework for Parsing 2D Engineering Drawings into Structured Manufacturing Knowledge