mlsanityData to 14 Oct 2026

From Pixels to PCells: A Neurosymbolic Approach to Photonic Component Creation

arXiv 2608.00084 ↗First posted 29 Jul 2026cs.CV physics.opticscited by 0

Not on the map. Why?

Abstract (arXiv)

We present PixCell, a neurosymbolic system in which multimodal agents convert a visually presented photonic component into a parametric program over a small domain-specific language (DSL) of geometric primitives. A system enabling deterministic visual verification renders evaluation asymmetrically cheaper than the generation attempt. While models using multi-seed sampling and iterative revision reach a mean best-turn IoU of only 0.416, multimodal agents through PixCell's interface and verifier consistently exceed 0.9 mean IoU, with scores reaching 0.974 and 0.955 across eight component targets while also satisfying source contracts. These results demonstrate that frontier multimodal agents can reliably understand and render executable parametric representations from visual targets. Using these live parameters, cross-stack studies on an interferometer reconstruct primitive programs that satisfy an 8.0 nm free spectral range target and the original footprint constraint on modeled 220-nm SOI, 400-nm SiN, and 400-nm TFLN stacks. PixCell further carries a paper-derived splitter from visual reconstruction through SOI full-wave simulation, producing symmetric propagation and balanced outputs. Finally, the same executable verifier supplies a training reward and dataset used to train a Qwen3.6-35B-A3B model with LoRA and GRPO without supervised demonstrations. On eight training-excluded paper figures, its mean champion IoU rises from 0.422 after eight initial attempts to 0.491 after three verifier-guided revision rounds. These results therefore establish a controlled framework for measuring, retargeting, and improving visual-to-parametric photonic component design.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 38 references that are in the map. First posted on arXiv 29 Jul 2026.

Builds on

13 of 38 references.

References · 13

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  5. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
  6. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 867
  7. 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?cited by 203
  8. 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 152
  9. 2017Learning to Infer Graphics Programs from Hand-Drawn Imagescited by 74
  10. 2025CADCrafter: Generating Computer-Aided Design Models from Unconstrained Imagescited by 35
  11. 2025Learning Only with Images: Visual Reinforcement Learning with Reasoning, Rendering, and Visual Feedbackcited by 32
  12. 2025AI Agents for Photonic Integrated Circuit Design Automationcited by 7
1 more
  1. 2025PICBench: Benchmarking LLMs for Photonic Integrated Circuits Designcited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026OPTIAGENT: A Physics-Driven Agentic Framework for Automated Optical Design
  2. 2022NeurOLight: A Physics-Agnostic Neural Operator Enabling Parametric Photonic Device Simulation
  3. 2026Inverse-designed meta processing units for multi-task near-field photonic computing
  4. 2026HALO: A Physics-Aware LLM Agent Framework for Nanophotonic Design
  5. 2026A Comprehensive Review of Large Language Models for Nanophotonics: From Surrogate Modeling to Autonomous Design
  6. 2026PICopilot: An LLM-based Agentic Framework for Assisting Photonic Integrated Circuit Design via Script Generation
  7. 2025GOBench: Benchmarking Geometric Optics Generation and Understanding of MLLMs
  8. 2026Learning Design Skills as Memory Policies for Agentic Photonic Inverse Design