mlsanityData to 14 Oct 2026

Quantum Circuit Vision: Cost-Aware Evaluation of Visual AI Agents for Quantum Code Generation

arXiv 2607.10057 ↗First posted 11 Jul 2026quant-ph cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Can AI agents visually comprehend quantum circuit diagrams and generate verified executable code--and at what cost? We present Quantum Circuit Vision, a cost-aware evaluation framework for multimodal AI agents on quantum circuit visual understanding. We construct a 132-circuit benchmark spanning 13 categories (1--10 qubits) with executable Amazon Braket code and unitary-fidelity verification. Evaluating three frontier Claude-family models at different capability-cost tiers with n=5 repeated trials, we find that the mid-tier model (Sonnet 4.6, 1.30× credits) offers the most favorable balance on the cost-accuracy frontier: 91% pass rate on the core subset at 18% of the per-call cost of the strongest model (Opus 4.6), whose accuracy advantage is not statistically significant (paired t: p=0.083). Logistic regression confirms that circuit depth--not qubit count--is the primary predictor of failure (p<0.001). Chain-of-thought prompting shows no statistically significant effect (all p>0.18, n=5), suggesting that visual pattern recognition outweighs explicit reasoning strategy for structurally coupled diagrams. We propose a cascade routing strategy (cheap rightarrow expensive models) that achieves 84% accuracy at 38% of single-model cost, demonstrating that model routing dominates prompt engineering as a cost lever. We release QCV-Dataset (132 circuits, 5 modalities, 1,931 files) on Hugging Face Hub as an open evaluation infrastructure with structured metadata for discoverability, interoperability, and responsible AI documentation, and all evaluation code, cost logs, and verification scripts on GitHub for full reproducibility.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 40 references that are in the map. First posted on arXiv 11 Jul 2026.

Builds on

17 of 40 references.

References · 17

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  3. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
  4. 2020Variational Quantum Algorithmscited by 692
  5. 2023VeriGen: A Large Language Model for Verilog Code Generationcited by 200
  6. 2023ChipNeMo: Domain-Adapted LLMs for Chip Designcited by 174
  7. 2023Chip-Chat: Challenges and Opportunities in Conversational Hardware Designcited by 140
  8. 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 92
  9. 2024Croissant: A Metadata Format for ML-Ready Datasetscited by 81
  10. 2021Quantum Federated Learning with Quantum Datacited by 53
  11. 2024MMCode: Benchmarking Multimodal Large Language Models for Code Generation with Visually Rich Programming Problemscited by 40
  12. 2026Dynamic Model Routing and Cascading for Efficient LLM Inference: A Surveycited by 19
5 more
  1. 2025Cost-Aware Contrastive Routing for LLMscited by 16
  2. 2025Code-Vision: Evaluating Multimodal LLMs Logic Understanding and Code Generation Capabilitiescited by 13
  3. 2026QCalEval: Benchmarking Vision-Language Models for Quantum Calibration Plot Understandingcited by 11
  4. 2026CASTER: Breaking the Cost-Performance Barrier in Multi-Agent Orchestration via Context-Aware Strategy for Task Efficient Routingcited by 3
  5. 2026CascadeDebate: Multi-Agent Deliberation for Cost-Aware LLM Cascadescited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Generative AI for Quantum Circuits and Quantum Code: A Technical Review and Taxonomy
  2. 2025QUASAR: Quantum Assembly Code Generation Using Tool-Augmented LLMs via Agentic RL
  3. 2026Position: Quantum Program Generation Must Prioritize Validity Over Probabilistic Scaling
  4. 2025Agent-Q: Fine-Tuning Large Language Models for Quantum Circuit Generation and Optimization
  5. 2026An LLM System for Autonomous Variational Quantum Circuit Design
  6. 2026RiverONE: Generating Knowledge-Intensive VLM by Simulated Quantum Machines
  7. 2025QHackBench: Benchmarking Large Language Models for Quantum Code Generation Using PennyLane Hackathon Challenges
  8. 2026Circuit Hypernetworks for Quantum-Augmented Diffusion Language Models