mlsanityData to 7 Oct 2026

Designing Any Imaging System from Natural Language: Agent-Constrained Composition over a Finite Primitive Basis

arXiv 2603.25636 ↗First posted 26 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Designing a computational imaging system -- selecting operators, setting parameters, validating consistency -- requires weeks of specialist effort per modality, creating an expertise bottleneck that excludes the broader scientific community from prototyping imaging instruments. We introduce spec.md, a structured specification format, and three autonomous agents -- Plan, Judge, and Execute -- that translate a one-sentence natural-language description into a validated forward model with bounded reconstruction error. A design-to-real error theorem decomposes total reconstruction error into five independently bounded terms, each linked to a corrective action. On 6 real-data modalities spanning all 5 carrier families, the automated pipeline matches expert-library quality (98.1 +/- 4.2%). Ten novel designs -- composing primitives into chains from 3D to 5D -- demonstrate compositional reach beyond any single-modality tool.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 46 references that are in the map. First posted on arXiv 26 Mar 2026.

Builds on

10 of 46 references.

References · 10

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  3. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  4. 2019Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processingcited by 411
  5. 2017MoDL: Model Based Deep Learning Architecture for Inverse Problemscited by 384
  6. 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 290
  7. 2017Learned Primal-dual Reconstructioncited by 251
  8. 2020End-to-End Variational Networks for Accelerated MRI Reconstructioncited by 201
  9. 2022Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imagingcited by 66
  10. 2026Eleven Primitives and Three Gates: The Universal Structure of Computational Imagingcited by 1

Built on by

Not cited yet.