Designing Any Imaging System from Natural Language: Agent-Constrained Composition over a Finite Primitive Basis
Not on the map. Why?
Abstract (arXiv)
Designing a computational imaging system -- selecting operators, setting parameters, validating consistency -- requires weeks of specialist effort per modality, creating an expertise bottleneck that excludes the broader scientific community from prototyping imaging instruments. We introduce spec.md, a structured specification format, and three autonomous agents -- Plan, Judge, and Execute -- that translate a one-sentence natural-language description into a validated forward model with bounded reconstruction error. A design-to-real error theorem decomposes total reconstruction error into five independently bounded terms, each linked to a corrective action. On 6 real-data modalities spanning all 5 carrier families, the automated pipeline matches expert-library quality (98.1 +/- 4.2%). Ten novel designs -- composing primitives into chains from 3D to 5D -- demonstrate compositional reach beyond any single-modality tool.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 46 references that are in the map. First posted on arXiv 26 Mar 2026.
Builds on
10 of 46 references.
References · 10
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2019Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processingcited by 411
- 2017MoDL: Model Based Deep Learning Architecture for Inverse Problemscited by 384
- 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 290
- 2017Learned Primal-dual Reconstructioncited by 251
- 2020End-to-End Variational Networks for Accelerated MRI Reconstructioncited by 201
- 2022Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imagingcited by 66
- 2026Eleven Primitives and Three Gates: The Universal Structure of Computational Imagingcited by 1
Built on by
Not cited yet.