Flowchart2Mermaid: A Vision-Language Model Powered System for Converting Flowcharts into Editable Diagram Code
Not on the map. Why?
Abstract (arXiv)
Flowcharts are common tools for communicating processes but are often shared as static images that cannot be easily edited or reused. We present Flowchart2Mermaid, a lightweight web system that converts flowchart images into editable Mermaid.js code which is a markup language for visual workflows, using a detailed system prompt and vision-language models. The interface supports mixed-initiative refinement through inline text editing, drag-and-drop node insertion, and natural-language commands interpreted by an integrated AI assistant. Unlike prior image-to-diagram tools, our approach produces a structured, version-controllable textual representation that remains synchronized with the rendered diagram. We further introduce evaluation metrics to assess structural accuracy, flow correctness, syntax validity, and completeness across multiple models.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 10 of its 25 references that are in the map. First posted on arXiv 1 Dec 2025.
Builds on
10 of 25 references.
References · 10
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
- 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
- 2024FlowVQA: Mapping Multimodal Logic in Visual Question Answering with Flowchartscited by 27
- 2024Structure Guided Prompt: Instructing Large Language Model in Multi-Step Reasoning by Exploring Graph Structure of the Textcited by 14
- 2024Beyond End-to-End VLMs: Leveraging Intermediate Text Representations for Superior Flowchart Understandingcited by 10
- 2022Confident AIcited by 6
- 2025Follow the Flow: Fine-grained Flowchart Attribution with Neurosymbolic Agentscited by 4
- 2025A Graph-based Approach for Multi-Modal Question Answering from Flowcharts in Telecom Documentscited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026EvoDiagram: Agentic Editable Diagram Creation via Design Expertise Evolutioncited by 1
- 2026PathWISE: Multi-Agent Cancer Pathway Triaging Ontology Learning from Clinical Flowchartscited by 0
- 2026EdgeFlow: Edge-Map Augmented VLM-Based Flowchart Processing for Industrial Requirements Engineeringcited by 0
- 2026EdgeFlow: Edge-Map Augmented VLM-Based Flowchart Processing for Industrial Requirements Engineering26 May 2026
- 2026PathWISE: Multi-Agent Cancer Pathway Triaging Ontology Learning from Clinical Flowcharts25 May 2026
- 2026EvoDiagram: Agentic Editable Diagram Creation via Design Expertise Evolution20 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025See it. Say it. Sorted: Agentic System for Compositional Diagram Generation
- 2026One Figure, Every Canvas: Editable Flowchart Relayout via Agentic Pipeline
- 2024FlowLearn: Evaluating Large Vision-Language Models on Flowchart Understanding
- 2026VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editing
- 2026An Online Reference-Free Evaluation Framework for Flowchart Image-to-Code Generation
- 2025StarFlow: Generating Structured Workflow Outputs From Sketch Images
- 2026GenAI-DrawIO-Creator: A Framework for Automated Diagram Generation
- 2026SAGE: Structured Agentic Graph Editing for Software Diagrams